-- Logs begin at Mon 2022-02-21 00:42:36 UTC, end at Mon 2022-02-21 01:56:12 UTC. -- Feb 21 01:12:40.817387 dv-cinder-813228-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 21 01:12:40.825779 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 01:12:40 2022] *** Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: nodename: dv-cinder-813228-6-iscsi Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: machine: x86_64 Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: clock source: unix Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: pcre jit disabled Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: detected number of CPU cores: 4 Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: current working directory: / Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: detected binary path: /usr/bin/uwsgi-core Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: your processes number limit is 47680 Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: your memory page size is 4096 bytes Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: detected max file descriptor number: 2048 Feb 21 01:12:40.827887 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: lock engine: pthread robust mutexes Feb 21 01:12:40.828666 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: thunder lock: enabled Feb 21 01:12:40.828666 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 21 01:12:40.828666 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 01:12:40.873273 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: Python main interpreter initialized at 0x55ee015929c0 Feb 21 01:12:40.873273 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: python threads support enabled Feb 21 01:12:40.873273 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: your server socket listen backlog is limited to 100 connections Feb 21 01:12:40.873273 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: your mercy for graceful operations on workers is 90 seconds Feb 21 01:12:40.873604 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 01:12:40.873680 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: *** Operational MODE: preforking *** Feb 21 01:12:40.874148 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: *** uWSGI is running in multiple interpreter mode *** Feb 21 01:12:40.874148 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: spawned uWSGI master process (pid: 79582) Feb 21 01:12:40.874349 dv-cinder-813228-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 21 01:12:40.876089 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: spawned uWSGI worker 1 (pid: 79595, cores: 1) Feb 21 01:12:40.877114 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: spawned uWSGI worker 2 (pid: 79596, cores: 1) Feb 21 01:12:40.878287 dv-cinder-813228-6-iscsi devstack@keystone.service[79582]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 01:12:46.626733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:12:46.626733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: from cryptography.utils import int_from_bytes Feb 21 01:12:46.627368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:12:46.627368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: from cryptography.utils import int_from_bytes Feb 21 01:12:46.636606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:12:46.636606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: from cryptography.utils import int_from_bytes Feb 21 01:12:46.637066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:12:46.637066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: from cryptography.utils import int_from_bytes Feb 21 01:12:46.672752 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:12:46.673025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:12:46.673172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] command line args: [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:12:46.673402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:12:46.673578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ================================================================================ {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:12:46.673834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] admin_token = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.674081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] config_dir = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.674267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.674448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] config_source = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.674624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] debug = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.674818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.675676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.675676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.675676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.675879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.676464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.676464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_config_append = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.676464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.676673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_dir = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.676743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_file = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.676936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.677180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.677423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.677670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.677845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.678019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.678261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.678502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.678733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.678963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.679192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.679464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.679709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.679952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.680224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.680413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:12:46.680634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:12:46.680749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.680871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] command line args: [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:12:46.680941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] publish_errors = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:12:46.681186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ================================================================================ {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:12:46.681345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] admin_token = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] config_dir = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.681955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] config_source = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] standard_threads = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] debug = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.682915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] use_journal = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] use_json = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] use_stderr = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683428 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] use_syslog = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_config_append = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.683966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.684049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.684144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_dir = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.684234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.684307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_file = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.684477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.684568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.684722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.684799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.684971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.685055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.685209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.685292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.685437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.685595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.685670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.685742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.685848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.685934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.686094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.686180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.686330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.686409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.686566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.686649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.686799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.686878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.687032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.687116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.687281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.687365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.687524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.687608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.687766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.687857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.688020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.688273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.688358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.688481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] publish_errors = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.688560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.688723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.688813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.688960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.689038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.689139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.689253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.689390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.689503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.689625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.689748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.689863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] standard_threads = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.689979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.690098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.690208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.690342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.690421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.690520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.690657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.690735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] use_journal = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.690885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] use_json = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.690959 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.691030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] use_stderr = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.691134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.691218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] use_syslog = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.691361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.691450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:12:46.691589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.691668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.691831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.691909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692577 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.692893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.693964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.694988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.695710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.695795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.695940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.696886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.697885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.698917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.699879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.700869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701496 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.701960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.702990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.703918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704401 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.704905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.705879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.706935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.707897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.708892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.external = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.709846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.password = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] auth.token = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.710769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.711341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.711516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.711595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.711760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.711840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.712979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.713942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.714966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715828 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.715908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.716911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.external = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.717905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.password = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.718883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] auth.token = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.719941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.720961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.721968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.722982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.723905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.724938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.725913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.726892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.727865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.728997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.729943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.730961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.731917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732822 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.732925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.733875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.734965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.735926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.736898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.737849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.738964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.739994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.740947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.741941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.742941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] role.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] role.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.743886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.744865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745352 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.745992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.746957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.747918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.748088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.748168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.748338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.748417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.748617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.748699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.749967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.750905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.751881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] role.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] role.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.752844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.753975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.754930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.755889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.756923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.connection = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.757097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.757186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.757354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.757433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.758922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.759864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.760857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.761885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:12:46.761957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.762216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.762467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.762709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.762957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.763209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.763463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.763705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.763948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.764199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.764469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.764725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.764962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.765211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.765517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.765783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.connection = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.766033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.766284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.766526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.766770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.767009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.767248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.767488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.767728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.767977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.768215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.768481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.768724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.768975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.769212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.769461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.769694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.769938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.770176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:12:46.770347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:12:46.792810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.793035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.793262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.797002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.797237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.797475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.801854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.806035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.830331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.830555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.832975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.833212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.885354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.885768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.934323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.934545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.935611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.935857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.999551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:46.999780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.000877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.001144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.001271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.025711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.025937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.026084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.026317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.026475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.026617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.026617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.026871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.027000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.027128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.027255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.027383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.027383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.027383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.038043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.038546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.050518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.050747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.050966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.051937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.052075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.052075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.052327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.052482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 01:12:47.069228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.069433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:12:47.069765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.069926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.070100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:12:47.070811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.071011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:12:47.071253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.071389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.071532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.071664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 01:12:47.071795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.071925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.072217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.072585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.072854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.082249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.082527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.082792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.083069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.083581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.083926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.084204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.084514 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.091012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.092611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.094319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.094595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.094869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.095144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.095421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.095676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.095937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.096067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.096195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.096321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.096480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.096610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.096740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.096871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.097010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.097149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.097280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.097539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.097817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.098085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.098353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.098618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.123394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.125233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.125510 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.125680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.127257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.127538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.130613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.130890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.131166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.133289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.133567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.133843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.139028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.139256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.141756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.142039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.143612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.143895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.144171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.144467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.144743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.145010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.145271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.145528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.146437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.146723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.147004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.147286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.147562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.147835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.148400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.148400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.163639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.163947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.166959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.167236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.168375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.171844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.171976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.172199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.175434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.175728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.177236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.181301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.181440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.184870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.185016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.185152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.185422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.185703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.185982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.186252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.188457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.188781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.189070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.189351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.189632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.189910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.205484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.205763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.206023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.206278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.209549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.209831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.210095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.210363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.214580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.216255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.216556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.218789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.219478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.219767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.220211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.220502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.220624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.220775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.220860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.223772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.224053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.224468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.224762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.225043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.234239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.234520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.234793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.235068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.235341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.235623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.235888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.238591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.238873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.239156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.239444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.239730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.240020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.240295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.254773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.258473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.259930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.261738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.263133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.263264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.266461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.268081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.367904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.368224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.368469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.371579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.371876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.372159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.375879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.377462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.379646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.380565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.380849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.381122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.381251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.381385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.384401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.384824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.385111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.385388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.390421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.390658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.390933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.394427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.394713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.394991 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.398644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.398920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.399194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.399471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.399748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.400004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.400272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.400659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.400928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.401299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.401583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.401858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.402120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.402375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.402766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 01:12:47.403053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.403330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.403603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.403874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.404152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.404436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.404817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.405105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.405378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.405649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.405916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.406180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.406438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 01:12:47.440062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ee015929c0 pid: 79596 (default app) Feb 21 01:12:47.443471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08f2f-7de8-4ab9-943e-c0c2947b890d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:47.443762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08f2f-7de8-4ab9-943e-c0c2947b890d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:47.444037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08f2f-7de8-4ab9-943e-c0c2947b890d None None] PATH_INFO: `/v3` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:47.444611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ee015929c0 pid: 79595 (default app) Feb 21 01:12:47.448248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 791 bytes} [Mon Feb 21 01:12:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:12:56.585376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e7491-5a60-4ecf-a244-f7c014e002ed None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:56.585993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e7491-5a60-4ecf-a244-f7c014e002ed None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:56.586097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e7491-5a60-4ecf-a244-f7c014e002ed None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:56.591626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1/2] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:12:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:12:56.597033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:56.597473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:56.597632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:56.628181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:12:56.810779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG passlib.handlers.bcrypt [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79596) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 01:12:56.811204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG passlib.handlers.bcrypt [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79596) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 01:12:56.865611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:12:56.867735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:56.986369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 2/3] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:12:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:12:57.173662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e7491-5a60-4ecf-a244-f7c014e002ed None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:57.206728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG oslo_db.sqlalchemy.engines [None req-c21e7491-5a60-4ecf-a244-f7c014e002ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:12:57.334980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e7491-5a60-4ecf-a244-f7c014e002ed None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:57.339271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:57.339920 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:57.340206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:57.340514 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:57.348528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:57.399452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 01:12:57.399797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bccaa-8e4c-47ba-a9ba-85a464286a78 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:57.408878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 2/4] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:12:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:12:57.415472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:57.429478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9278c4-ddf4-4380-882f-ac4f2bca77de None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:57.433789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:57.434919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:57.435202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:57.435483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] PATH_INFO: `/v3/projects/9596a32ec75d4659b27e6c7a766d2b35` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:57.437035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] RBAC: Authorizing `identity:get_project(project_id=9596a32ec75d4659b27e6c7a766d2b35)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:57.488563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 01:12:57.488910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd13357-b75b-458c-a27b-b1e8a9712671 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:57.494139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 3/5] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:12:57 2022] GET /identity/v3/projects/9596a32ec75d4659b27e6c7a766d2b35 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:12:59.775416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263585-4ebd-4a47-a2e3-d65b3339d85f None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:59.775932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263585-4ebd-4a47-a2e3-d65b3339d85f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:59.776026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263585-4ebd-4a47-a2e3-d65b3339d85f None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:59.780517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 3/6] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:12:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:12:59.785768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:59.786198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:59.786343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:59.805193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:12:59.806718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:59.814938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 4/7] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:12:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:12:59.838738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263585-4ebd-4a47-a2e3-d65b3339d85f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:59.859410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263585-4ebd-4a47-a2e3-d65b3339d85f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:59.863611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79b89-457a-4614-89e0-b02895047d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:59.864243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79b89-457a-4614-89e0-b02895047d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:59.864562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79b89-457a-4614-89e0-b02895047d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:59.864840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79b89-457a-4614-89e0-b02895047d01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:59.872340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b79b89-457a-4614-89e0-b02895047d01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:59.874357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b79b89-457a-4614-89e0-b02895047d01 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:59.882801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 4/8] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:12:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:12:59.888300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:59.897225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8343ee4-2e1a-463a-ba4e-8dc51143b937 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:59.902139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db3cc-41e5-49c5-965e-fe3fc2873a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:59.902993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db3cc-41e5-49c5-965e-fe3fc2873a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:59.903281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db3cc-41e5-49c5-965e-fe3fc2873a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:59.903562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db3cc-41e5-49c5-965e-fe3fc2873a57 admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:59.904990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db3cc-41e5-49c5-965e-fe3fc2873a57 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:59.906837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db3cc-41e5-49c5-965e-fe3fc2873a57 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:59.908381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 5/9] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:12:59 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:02.268393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4394d-da75-4092-97cd-b82751d2ab9b None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.268957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4394d-da75-4092-97cd-b82751d2ab9b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.269042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4394d-da75-4092-97cd-b82751d2ab9b None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.270729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 5/10] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:02.275881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.276311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.276576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.281915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964222e-d667-434f-a63c-02e74cc8f8cc None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.282206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964222e-d667-434f-a63c-02e74cc8f8cc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.282495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964222e-d667-434f-a63c-02e74cc8f8cc None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.284144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 6/11] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:02.290019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.290309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.290590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.294754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:02.295956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:02.303737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 6/12] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:02.327382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.332115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG passlib.handlers.bcrypt [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79595) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 01:13:02.332553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG passlib.handlers.bcrypt [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79595) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 01:13:02.336411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590503a-c978-426e-910f-7c5ed9c3d311 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.341118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.341751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.342040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.342322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.350076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:02.352409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:02.361168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 7/13] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:02.366323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.375821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8473d6-4996-4494-8c68-bb4f1f4c1fd8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.379543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:02.380300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.381154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:02.381260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.381443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.381723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.382990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:02.384740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:02.386259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 8/14] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:02.403121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 7/15] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:02.428362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.439293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22720fa-30c5-4737-a627-e963374e27d0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.443921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.444785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.445075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.445359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.459853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:02.467125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:02.468420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 9/16] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:02.474355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.484551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab6b44-a1a6-47bf-93c9-e9d9b36ba7e1 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.488993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.490021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.490308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.490589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.491557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:02.492509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:02.494338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:02.494338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:02.494338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:02.495256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:02.512530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 8/17] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:02.518499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.528473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f92ae-3fff-42dd-9a87-1ed3bd186af2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.532975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.533864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.534148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.534427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.535682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:02.537596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:02.539817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 10/18] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:02.545397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.555747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfd5-e707-4c3f-8cc2-e774c9eec208 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.560386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05fbc6-e01a-41a6-8af7-7f7dbc97fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.561205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05fbc6-e01a-41a6-8af7-7f7dbc97fb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.561492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05fbc6-e01a-41a6-8af7-7f7dbc97fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.561768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05fbc6-e01a-41a6-8af7-7f7dbc97fb28 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.563175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05fbc6-e01a-41a6-8af7-7f7dbc97fb28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:02.564934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05fbc6-e01a-41a6-8af7-7f7dbc97fb28 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:02.566508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 9/19] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:02.572580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:02.582219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122ca67-119d-4c4d-bbeb-0b090e62d71a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:02.586651 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:02.587342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:02.587622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:02.587897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:02.588792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.domain.id=default, user.id=1f7f9c623a1f47c79a8fa4a52a1af83b) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:02.589100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:02.590838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:02.590838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:02.590838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:02.591987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb5233-0d36-437e-94fe-e161bcf2ddec admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:02.598830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 11/20] 10.222.0.90 () {56 vars in 1343 bytes} [Mon Feb 21 01:13:02 2022] GET /identity/v3/role_assignments?user.id=1f7f9c623a1f47c79a8fa4a52a1af83b&scope.domain.id=default&role.id=2b566b9d44514140984818f0428be699 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:05.138519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabfb51-e38d-4a42-bd42-17ab25f02931 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.139365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabfb51-e38d-4a42-bd42-17ab25f02931 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.139815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabfb51-e38d-4a42-bd42-17ab25f02931 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.142186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:05.147299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.148080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.148527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.173431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:05.174847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:05.183708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 12/22] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:05.229909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabfb51-e38d-4a42-bd42-17ab25f02931 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.246012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabfb51-e38d-4a42-bd42-17ab25f02931 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.250825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.251611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.251896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.252171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.276688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.278585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.306539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:13:05.308204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 11/23] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:05.313836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.323007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214aa2f-2542-4b9d-ac42-fde3bb7292f9 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.332614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.333274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.333558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.333836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.334564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:05.334870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.335920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:05.335920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:05.335920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:05.336905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d404699-7ff2-41ed-997a-eaaf1d1e9572 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.363819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 13/24] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:05.370339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.380496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5153cd-08ef-4da8-8073-28c5fb95a4bb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.388770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.389379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.389665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.389949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.390684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.391719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:05.391719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:05.391719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:05.394607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abfd89-0290-4e03-b80f-2a25e4c92405 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.394888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abfd89-0290-4e03-b80f-2a25e4c92405 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.395167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abfd89-0290-4e03-b80f-2a25e4c92405 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.397312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 14/25] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:05.397542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.403265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.403798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.404253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.433989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:05.435593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:05.449729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 15/26] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:05.490425 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.501719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ec00-15d2-4aed-986b-3ada61725c93 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.508713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.509513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.509798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.510072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.529531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:05.537100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:05.539075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 16/27] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:05.551701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.566432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234cac-3eca-4f4e-95ab-158742313e58 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.581833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.582766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.583231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.583712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.584666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:05.585143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.586381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:05.586381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:05.586381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:05.587617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b752370-8647-43bc-b62f-5f06a31fdc61 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.608226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 17/28] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:05.609807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb278-a946-49d2-ad82-1dea8bed426b None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.610271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb278-a946-49d2-ad82-1dea8bed426b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.610729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb278-a946-49d2-ad82-1dea8bed426b None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.617721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 18/29] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:05.618720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb278-a946-49d2-ad82-1dea8bed426b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.653171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb278-a946-49d2-ad82-1dea8bed426b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.671287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7b587-cfec-47cd-9c53-26b0d58f4a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.671287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b587-cfec-47cd-9c53-26b0d58f4a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.671287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b587-cfec-47cd-9c53-26b0d58f4a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.671287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b587-cfec-47cd-9c53-26b0d58f4a60 admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.672122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7b587-cfec-47cd-9c53-26b0d58f4a60 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.674069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7b587-cfec-47cd-9c53-26b0d58f4a60 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.680447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 19/30] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:05 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:05.680447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.680447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.680447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.680767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 12/31] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:13:05 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:05.686677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.717190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:05.718884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:05.819966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 20/32] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:05.851672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.861722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88e96a-29bd-452a-bb4d-1ce7fa9020ee admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.868737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ee050-d7de-4efb-8339-71f921883ac0 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.875715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.876414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.876724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.877005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.877792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.878830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:05.878830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:05.878830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:05.879760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061338-b4a1-425e-9a0f-f2139bc71ef0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.889855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.890345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.890635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.890917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.892275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.894225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:05.900654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 13/33] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:05.903237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:05.918536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5659699-871d-4ff2-95f9-65e6f8f946c5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:05.923123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:05.925138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:05.925138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:05.925138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] PATH_INFO: `/v3/domains/default/users/1f7f9c623a1f47c79a8fa4a52a1af83b/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:05.929874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1f7f9c623a1f47c79a8fa4a52a1af83b, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:05.931245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:05.931245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:05.931245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:05.933887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7bbe-08e3-4626-b31b-47f195c774b4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:06.031505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 14/34] 10.222.0.90 () {58 vars in 1382 bytes} [Mon Feb 21 01:13:05 2022] PUT /identity/v3/domains/default/users/1f7f9c623a1f47c79a8fa4a52a1af83b/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:13:06.122432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 21/35] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:13:05 2022] POST /identity/v3/roles => generated 219 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:06.155090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c34e-f595-4663-b8fe-4e541543e134 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.155648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c34e-f595-4663-b8fe-4e541543e134 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.155648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c34e-f595-4663-b8fe-4e541543e134 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.157821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 15/36] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:06.164021 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b97eb-d138-415b-b1cb-62b400c084d2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.165088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b97eb-d138-415b-b1cb-62b400c084d2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.165609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b97eb-d138-415b-b1cb-62b400c084d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.190460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9a1b97eb-d138-415b-b1cb-62b400c084d2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:06.192489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9a1b97eb-d138-415b-b1cb-62b400c084d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:06.277191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 22/37] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:06.303294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c34e-f595-4663-b8fe-4e541543e134 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:06.318816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c34e-f595-4663-b8fe-4e541543e134 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:06.324653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:06.325337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.325674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.325955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.326805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:06.328704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:06.328704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:06.328704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:06.328904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b04a4-2d63-4f64-aa1d-9c89d03fd6c2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:06.412337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 16/38] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:13:06 2022] POST /identity/v3/roles => generated 225 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:06.451515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20ea5-99ba-4a2a-85f6-16a67fcb45de None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.451804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20ea5-99ba-4a2a-85f6-16a67fcb45de None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.452089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20ea5-99ba-4a2a-85f6-16a67fcb45de None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.453989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 23/39] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:06.459790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.460170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.460572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.480598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:06.482333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:06.491052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 17/40] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:06.517919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20ea5-99ba-4a2a-85f6-16a67fcb45de None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:06.534940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20ea5-99ba-4a2a-85f6-16a67fcb45de None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:06.539940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c01744-d14b-4820-9aaa-1c252e51511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:06.540804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01744-d14b-4820-9aaa-1c252e51511f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.541141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01744-d14b-4820-9aaa-1c252e51511f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.541429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01744-d14b-4820-9aaa-1c252e51511f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.542782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c01744-d14b-4820-9aaa-1c252e51511f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:06.544784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c01744-d14b-4820-9aaa-1c252e51511f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:06.546930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 24/41] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:06.552523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:06.563130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31cc2-58b2-4ce3-ad59-076c56209e43 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:06.567809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc808230-8903-4160-b1a2-4a30626fc07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:06.568527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc808230-8903-4160-b1a2-4a30626fc07d admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.568819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc808230-8903-4160-b1a2-4a30626fc07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.569158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc808230-8903-4160-b1a2-4a30626fc07d admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.570526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc808230-8903-4160-b1a2-4a30626fc07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:06.572523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc808230-8903-4160-b1a2-4a30626fc07d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:06.667333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 18/42] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:13:06 2022] POST /identity/v3/projects => generated 312 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:06.906885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52cb53-4287-45fb-93a0-f9b4f427d361 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.907175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52cb53-4287-45fb-93a0-f9b4f427d361 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.907623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52cb53-4287-45fb-93a0-f9b4f427d361 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.909593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 25/43] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:06.914813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ebd5-ef06-4339-bcff-a90fe1a6c36b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:06.915276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ebd5-ef06-4339-bcff-a90fe1a6c36b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:06.915561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ebd5-ef06-4339-bcff-a90fe1a6c36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:06.932959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-c539ebd5-ef06-4339-bcff-a90fe1a6c36b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:06.934076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c539ebd5-ef06-4339-bcff-a90fe1a6c36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:06.991016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 19/44] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:07.014220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52cb53-4287-45fb-93a0-f9b4f427d361 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:07.026952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52cb53-4287-45fb-93a0-f9b4f427d361 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:07.031236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95383e-65fa-4dfb-b726-d2305ccef8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:07.031901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95383e-65fa-4dfb-b726-d2305ccef8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:07.032188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95383e-65fa-4dfb-b726-d2305ccef8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:07.032562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95383e-65fa-4dfb-b726-d2305ccef8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:07.033332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95383e-65fa-4dfb-b726-d2305ccef8d7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:07.035049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95383e-65fa-4dfb-b726-d2305ccef8d7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:07.129340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 26/45] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:13:07 2022] POST /identity/v3/roles => generated 223 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:08.466459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a819cb-cc44-496c-8537-7db178f3f023 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.467003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a819cb-cc44-496c-8537-7db178f3f023 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.467003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a819cb-cc44-496c-8537-7db178f3f023 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.468829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 20/46] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:08.474133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.474538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.474711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.492031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:08.493255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:08.501304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 27/47] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:08.525404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a819cb-cc44-496c-8537-7db178f3f023 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:08.537360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a819cb-cc44-496c-8537-7db178f3f023 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:08.541661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:08.542442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.542729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.543010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.553989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:08.560910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:08.562250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 21/48] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:08.567630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:08.577086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf4c9-1331-432d-9126-06224b9a2304 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:08.581464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:08.582142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.582428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.582709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.583477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:08.583790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:08.586143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:08.595508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 28/49] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:08.601375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:08.612091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410c7fc-b4e9-4c48-b780-538c689306d0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:08.619699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:08.620619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.620912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.621194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.622414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:08.624538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:08.626146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 22/50] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:08 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:08.631561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:08.641940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa998d5-c0fe-487a-a377-8101a90a1e82 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:08.646333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cf3e7-8e30-4a13-adb9-560684b51b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:08.647116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cf3e7-8e30-4a13-adb9-560684b51b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.647405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cf3e7-8e30-4a13-adb9-560684b51b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.647688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cf3e7-8e30-4a13-adb9-560684b51b3e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.648916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cf3e7-8e30-4a13-adb9-560684b51b3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:08.650647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cf3e7-8e30-4a13-adb9-560684b51b3e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:08.652216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 29/51] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:08.657829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:08.667368 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee93c7-dcab-428e-a6e4-3fa997202c5a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:08.671728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:08.672374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.672694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.672976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.673813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.domain.id=default, user.id=1f7f9c623a1f47c79a8fa4a52a1af83b) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:08.674128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:08.675130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:08.675130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:08.675130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:08.676300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a0bd-99da-4570-8b95-eeff77dc14c1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:08.683867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 23/52] 10.222.0.90 () {56 vars in 1343 bytes} [Mon Feb 21 01:13:08 2022] GET /identity/v3/role_assignments?user.id=1f7f9c623a1f47c79a8fa4a52a1af83b&scope.domain.id=default&role.id=2b566b9d44514140984818f0428be699 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:08.951519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8dca7-5116-40d6-a953-bf3b894a351b None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.951808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8dca7-5116-40d6-a953-bf3b894a351b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.952088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8dca7-5116-40d6-a953-bf3b894a351b None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.953941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 30/53] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:08.959215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:08.959508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:08.959791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:08.977144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:08.978322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:08.985771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 24/54] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:09.010012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8dca7-5116-40d6-a953-bf3b894a351b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:09.021785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8dca7-5116-40d6-a953-bf3b894a351b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:09.025984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2343d-f274-4653-969d-22280fe6b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:09.026750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2343d-f274-4653-969d-22280fe6b997 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:09.027037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2343d-f274-4653-969d-22280fe6b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:09.027319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2343d-f274-4653-969d-22280fe6b997 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:09.028504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2343d-f274-4653-969d-22280fe6b997 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:09.030213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2343d-f274-4653-969d-22280fe6b997 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:09.031745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 31/55] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:09.036660 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:09.045683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc550-4cad-48be-9d8c-2b81568d1233 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:09.049942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6b1e9-bf6c-4979-b04d-450b0061580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:09.050573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b1e9-bf6c-4979-b04d-450b0061580b admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:09.050857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b1e9-bf6c-4979-b04d-450b0061580b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:09.051134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b1e9-bf6c-4979-b04d-450b0061580b admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:09.051830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6b1e9-bf6c-4979-b04d-450b0061580b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:09.053808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6b1e9-bf6c-4979-b04d-450b0061580b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:09.145879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 25/56] 10.222.0.90 () {60 vars in 1161 bytes} [Mon Feb 21 01:13:09 2022] POST /identity/v3/projects => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:11.405190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9804d94-7f0f-4d22-9a61-163bdda83edb None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:11.405755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9804d94-7f0f-4d22-9a61-163bdda83edb None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:11.405755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9804d94-7f0f-4d22-9a61-163bdda83edb None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:11.407489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 32/57] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:11.412805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce301-100a-4225-bed2-c8151508e09c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:11.413725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce301-100a-4225-bed2-c8151508e09c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:11.413851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce301-100a-4225-bed2-c8151508e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:11.431628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-badce301-100a-4225-bed2-c8151508e09c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:11.432855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-badce301-100a-4225-bed2-c8151508e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:11.488263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 26/58] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:11.514282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9804d94-7f0f-4d22-9a61-163bdda83edb None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:11.530411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9804d94-7f0f-4d22-9a61-163bdda83edb None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:11.536725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21209d-38ec-4ceb-a88f-034757cc397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:11.537889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21209d-38ec-4ceb-a88f-034757cc397e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:11.538827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21209d-38ec-4ceb-a88f-034757cc397e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:11.539250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21209d-38ec-4ceb-a88f-034757cc397e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:11.541038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21209d-38ec-4ceb-a88f-034757cc397e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:11.543742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21209d-38ec-4ceb-a88f-034757cc397e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:11.546268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 33/59] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:11.551621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badce301-100a-4225-bed2-c8151508e09c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:11.561090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badce301-100a-4225-bed2-c8151508e09c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:11.565400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:11.566047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:11.566329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:11.566605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:11.567306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:11.568309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:11.568309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:11.568309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:11.569564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb22b8-3bd9-4943-aa52-491b139744cf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:11.659377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 27/60] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:11 2022] POST /identity/v3/users => generated 275 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:15.315720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13014-47ea-42ec-9708-7d343b94c2ae None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.316771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13014-47ea-42ec-9708-7d343b94c2ae None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.317278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13014-47ea-42ec-9708-7d343b94c2ae None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.320168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 34/61] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:15.328386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6dd5-bba3-4aae-bc43-1beeabe66087 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.328386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6dd5-bba3-4aae-bc43-1beeabe66087 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.328386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6dd5-bba3-4aae-bc43-1beeabe66087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.353670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-218c6dd5-bba3-4aae-bc43-1beeabe66087 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:15.355244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-218c6dd5-bba3-4aae-bc43-1beeabe66087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:15.363935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 28/62] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:15.404848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13014-47ea-42ec-9708-7d343b94c2ae None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.424371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13014-47ea-42ec-9708-7d343b94c2ae None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.429497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c4a5-caed-4239-9fd8-39999497b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.430300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c4a5-caed-4239-9fd8-39999497b9df admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.430584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c4a5-caed-4239-9fd8-39999497b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.430865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c4a5-caed-4239-9fd8-39999497b9df admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.439347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f189b-048c-475d-b35a-36cd46d5206c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.439654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f189b-048c-475d-b35a-36cd46d5206c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.439941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f189b-048c-475d-b35a-36cd46d5206c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.442117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 29/63] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:15.445177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5343b-a611-4496-95cc-f1ae16a61347 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.445707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5343b-a611-4496-95cc-f1ae16a61347 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.446201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5343b-a611-4496-95cc-f1ae16a61347 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.448687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 30/64] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:15.449999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.450516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.450993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.451662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c4a5-caed-4239-9fd8-39999497b9df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:15.459159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-1627c4a5-caed-4239-9fd8-39999497b9df admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:15.460919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 35/65] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:15.463543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eeb6c-31b1-4865-8bf1-a06e6147e2cf None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.464053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eeb6c-31b1-4865-8bf1-a06e6147e2cf None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.464561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eeb6c-31b1-4865-8bf1-a06e6147e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.475860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:15.477341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:15.483717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c63eeb6c-31b1-4865-8bf1-a06e6147e2cf None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:15.485061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c63eeb6c-31b1-4865-8bf1-a06e6147e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:15.486189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 31/66] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:15.492447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.500664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 36/67] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:15.502838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebfbcd-e7b8-4e65-bc9f-1204d19e9088 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.503131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebfbcd-e7b8-4e65-bc9f-1204d19e9088 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.503409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebfbcd-e7b8-4e65-bc9f-1204d19e9088 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.505224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 37/68] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:15.508039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878a9a5-6073-4b40-9c21-097bdf1ca67d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.512535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.513200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.513484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.513761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.514512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.514892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.516122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebfbcd-e7b8-4e65-bc9f-1204d19e9088 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.517976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7b27-65fa-47fa-8392-7fa9bf9c7817 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.527876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 32/69] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.529922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.530028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebfbcd-e7b8-4e65-bc9f-1204d19e9088 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.530618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.531113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.534349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.535126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.535407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.535681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.546794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:15.548957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:15.550159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:15.553593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:15.555594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 38/70] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:15.556617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.561778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 33/71] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:15.562664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.570216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe33b0-3ece-4d42-a60e-41781da6ca64 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.572275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a52ae-4422-4168-9160-44e9e7322cd2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.574972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.575892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.576329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.576829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.577303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.578258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.578475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.578768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.579146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.580683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.582390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 39/72] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.583269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.592895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9073b45-e3e4-404e-b74d-4087805da4c3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.595779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.597721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.598070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.598372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.598653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.598928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.599671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.599769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 34/73] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.599978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.600533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.601996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.610010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42140b81-65fb-4574-8e4f-ae7238734761 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.610694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 40/74] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.611490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.615508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.616971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.617496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.617787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.618517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.620500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.624084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79bf0a-a65f-4690-a96d-649be6c16d05 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.628700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.629485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.629767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.630045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.640791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:15.648048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:15.649264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 41/75] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:15.650023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.663232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162084b8-7a1b-4fb6-afc0-f0d86dd2fedd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.667472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.668102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.668358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.668672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.680534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.682340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.691176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 42/76] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:15.691954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.702158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf1bf-9253-43ed-89f1-d35d2c6726de admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.703788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 35/77] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:15 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:15.704675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.707980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.708908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.709351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.709622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.710930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.713372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.719569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 43/78] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.719569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.723997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aca7a6-273d-4e80-b606-d2a3231fd452 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.730545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.731163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fadc9-7d4c-4160-8924-42606664c653 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.731952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.732468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.732940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.733953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.734464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.735935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.736835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dacdaa-5da2-45e5-af5c-3148bd070c30 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.737184 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.737472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.737755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.739421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.742766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.750347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 44/79] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.750347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.750578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 36/80] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.750578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe6a5-64cc-4b80-b7b4-77ee7a64f793 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.752473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe6a5-64cc-4b80-b7b4-77ee7a64f793 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.753154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe6a5-64cc-4b80-b7b4-77ee7a64f793 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.755276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 37/81] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:15.756538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fe6a5-64cc-4b80-b7b4-77ee7a64f793 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.761981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db5bc1-6d47-4585-96c0-b63e4e23b981 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.766823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be71a2a-66fc-4f77-8423-8ed42fcf2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.767480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be71a2a-66fc-4f77-8423-8ed42fcf2bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.767765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be71a2a-66fc-4f77-8423-8ed42fcf2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.768046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be71a2a-66fc-4f77-8423-8ed42fcf2bf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.771282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fe6a5-64cc-4b80-b7b4-77ee7a64f793 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.776064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.776767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.776952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be71a2a-66fc-4f77-8423-8ed42fcf2bf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.777058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.777311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.778149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=8e0324dddc2245d1a18abd9fe6173b2b) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.778459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.778746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be71a2a-66fc-4f77-8423-8ed42fcf2bf9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.780372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.792611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 38/82] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/role_assignments?user.id=8e0324dddc2245d1a18abd9fe6173b2b&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=246514336b4549609174329cae41663a => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.792611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.792895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 45/83] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:15.792895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.792895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.792895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.810447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35dd07-7bff-49ba-b775-aa3a845515b0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.813822 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:15.815633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.815823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:15.816777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.817143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.817498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.819029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.821708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.823599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 39/84] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.825569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 46/85] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:15.830181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.830781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.847987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea41362-cbf5-4658-8eed-0d95b1d44757 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.851092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189f9d5-173f-495a-b4ca-54f2da5d99a3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.860467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.861371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.862259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.862545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.862825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.864201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.864504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.864804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.865963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.869583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.873848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 40/86] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.874873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.875634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.876946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.887327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00099e-51ab-4a06-91a0-88badee9f863 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.887693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 47/87] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:15.892234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.900887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.901875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.902317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.902705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.904006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05ecac-1766-4c31-afb6-c3b47b4b5918 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.909617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.910250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.910540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.910820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.911675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=1f7f9c623a1f47c79a8fa4a52a1af83b) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.912168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.914612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.916190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:15.920599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 48/88] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/role_assignments?user.id=1f7f9c623a1f47c79a8fa4a52a1af83b&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.921517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.923631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:15.926160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 41/89] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:15.932176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.932882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69749-cd9e-45e6-bfd8-c8ddd43f4c80 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.937440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.938363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.938650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.938922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.940252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.942500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.945284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21230102-1794-45c9-be70-ad8674a55087 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.945525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 49/90] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.952062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.956116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.957109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.957613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.958130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.959387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.959697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.962005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.963125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771644d4-870e-4e57-8c78-d5f425cf4659 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.969551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:15.970232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:15.970526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:15.970811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:15.971744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] RBAC: Adding query filter params (role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=8e0324dddc2245d1a18abd9fe6173b2b) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:15.972067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:15.973141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 42/91] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.974305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:15.978988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:15.980942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 50/92] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/role_assignments?user.id=8e0324dddc2245d1a18abd9fe6173b2b&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:15.994626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582f2f6-d790-4b90-a57d-63dfc270c0ff admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:15.999983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:16.000979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:16.001268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:16.001554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:16.002960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:16.005342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:16.009826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 43/93] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:15 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:16.018482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:16.031862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a341b-8641-43b1-8b69-2b68e57d9d64 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:16.036952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:16.037638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:16.037937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:16.038595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:16.048524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:16.050452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:16.062344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 51/94] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:16.068552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:16.080044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1d58-31be-469b-b842-97b1ab183d64 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:16.086057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5422-3d7b-40a2-990b-4d24bc1bf7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:16.086963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5422-3d7b-40a2-990b-4d24bc1bf7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:16.087254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5422-3d7b-40a2-990b-4d24bc1bf7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:16.088049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5422-3d7b-40a2-990b-4d24bc1bf7e1 admin admin] PATH_INFO: `/v3/projects/e2fea86a25934d008586c9b51f530873` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:16.089517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe5422-3d7b-40a2-990b-4d24bc1bf7e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fea86a25934d008586c9b51f530873)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:16.091777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe5422-3d7b-40a2-990b-4d24bc1bf7e1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:16.093715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 44/95] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:16 2022] GET /identity/v3/projects/e2fea86a25934d008586c9b51f530873 => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:16.100181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:16.109843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e4956-9c97-4154-b020-b260c1c00e88 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:16.117558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:16.118419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:16.118710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:16.118997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:16.119878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, scope.project.id=e2fea86a25934d008586c9b51f530873, user.id=8e0324dddc2245d1a18abd9fe6173b2b) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:16.120200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:16.122230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34a29c-b4a5-4059-86da-0811506eee1e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:16.130610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 52/96] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:16 2022] GET /identity/v3/role_assignments?user.id=8e0324dddc2245d1a18abd9fe6173b2b&scope.project.id=e2fea86a25934d008586c9b51f530873&role.id=246514336b4549609174329cae41663a => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:18.939388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79badb8f-879d-417f-bed3-0e7f0e869450 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:18.940373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79badb8f-879d-417f-bed3-0e7f0e869450 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:18.940884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79badb8f-879d-417f-bed3-0e7f0e869450 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:18.941573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdc81-160f-4619-a7b0-4319a653f53a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:18.942354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdc81-160f-4619-a7b0-4319a653f53a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:18.942841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdc81-160f-4619-a7b0-4319a653f53a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:18.943230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 45/97] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:18.945735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 53/98] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:18.951004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:18.951296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:18.951577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:18.955399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:18.955683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:18.956183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:18.984500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:18.986167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:18.990946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:18.993820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:19.007274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 54/99] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:19.013748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 46/100] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:19.048957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.054613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.065898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52053-4086-4738-9030-428b309d7b19 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.068966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51ff3-e87d-4c50-9c6c-7d9e1d12350d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.076440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.077956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.078664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.079662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.080166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.080670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.081649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.082122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.102885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:19.110205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:19.111328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:19.119715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 55/101] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:19.120270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:19.121703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 47/102] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:19.127569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.133845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.144985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742cc62-192f-45e6-997b-da1913644ce5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.150504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b67d94-2fef-4095-b4de-d27ccd7f68d4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.157139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.158506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.159244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.159778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.160660 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.161141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.162099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:19.162571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.163113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.163612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.164592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:19.166436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.166953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.168796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.184215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 56/103] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.190008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.192100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 48/104] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.197802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.214475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c06c3-501d-4643-b4a7-5a7921fbd7e3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.216748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88ea54-1126-43f7-a2ee-7e7229fe0e57 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.224698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c8a7-ed8f-4036-a335-d9571489b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.225509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922561d-a5ec-42a4-84a0-95baeaf6f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.226662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c8a7-ed8f-4036-a335-d9571489b4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.227721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922561d-a5ec-42a4-84a0-95baeaf6f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.228198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c8a7-ed8f-4036-a335-d9571489b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.228706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922561d-a5ec-42a4-84a0-95baeaf6f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.229178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c8a7-ed8f-4036-a335-d9571489b4a0 admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.229646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922561d-a5ec-42a4-84a0-95baeaf6f2bb admin admin] PATH_INFO: `/v3/users/57d2a3fd5e6a4ce2952daaf06db362ce` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.231629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726c8a7-ed8f-4036-a335-d9571489b4a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.234222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726c8a7-ed8f-4036-a335-d9571489b4a0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.237383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 49/105] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.238827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d7fe9-ef30-4a4f-80d5-e124d4bf96ac None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.239311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d7fe9-ef30-4a4f-80d5-e124d4bf96ac None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.239808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d7fe9-ef30-4a4f-80d5-e124d4bf96ac None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.242304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 50/106] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:19.243231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d7fe9-ef30-4a4f-80d5-e124d4bf96ac None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.251148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922561d-a5ec-42a4-84a0-95baeaf6f2bb admin admin] RBAC: Authorizing `identity:get_user(user_id=57d2a3fd5e6a4ce2952daaf06db362ce)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.253546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922561d-a5ec-42a4-84a0-95baeaf6f2bb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.255385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 57/107] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/users/57d2a3fd5e6a4ce2952daaf06db362ce => generated 289 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:19.256800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.257846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.258361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.275865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:19.277313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:19.279266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d7fe9-ef30-4a4f-80d5-e124d4bf96ac None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.288055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 58/108] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:19.288808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.289825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.290783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.291205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.292009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.297438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.299636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.305091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 51/109] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.307541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290ef1-5ed5-4acb-8db0-748cc0ce05ca None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.308479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.320148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.321201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.323329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159395-8e2d-497a-9453-9963f441bc87 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.323764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.324195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.333883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ebb40-4e4b-4922-ba1b-91be2a70eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.334412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.334772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ebb40-4e4b-4922-ba1b-91be2a70eba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.335099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ebb40-4e4b-4922-ba1b-91be2a70eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.335373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ebb40-4e4b-4922-ba1b-91be2a70eba4 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/8e0324dddc2245d1a18abd9fe6173b2b/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.337222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.337525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ebb40-4e4b-4922-ba1b-91be2a70eba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2abaf64745eb9e2eac4926e4870d, user_id=8e0324dddc2245d1a18abd9fe6173b2b, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.340356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ebb40-4e4b-4922-ba1b-91be2a70eba4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.346991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 59/110] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:19.348024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.356576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eccdc7-316e-4183-a883-631ad5f182e6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.360858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d82e-dea7-4f58-b6b1-bbb1ee700136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.361631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d82e-dea7-4f58-b6b1-bbb1ee700136 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.361916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d82e-dea7-4f58-b6b1-bbb1ee700136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.362190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d82e-dea7-4f58-b6b1-bbb1ee700136 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.373082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d82e-dea7-4f58-b6b1-bbb1ee700136 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:19.380152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-f112d82e-dea7-4f58-b6b1-bbb1ee700136 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:19.381537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 60/111] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:19.384501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7c79-f9e1-4385-8585-917b26d2e8fe None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.384501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7c79-f9e1-4385-8585-917b26d2e8fe None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.384501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7c79-f9e1-4385-8585-917b26d2e8fe None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.385647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 61/112] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:19.386344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7c79-f9e1-4385-8585-917b26d2e8fe None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.398241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7c79-f9e1-4385-8585-917b26d2e8fe None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.402486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.403305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.403588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.403914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.405138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.407325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.408962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 62/113] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.409781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.417457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 52/114] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:19 2022] PUT /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/8e0324dddc2245d1a18abd9fe6173b2b/roles/246514336b4549609174329cae41663a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:19.419278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.419738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.420181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.424316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb147760-c239-49ed-9932-6864a86dfdde admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.445393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:19.447580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:19.481637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.482685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.483248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.483699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.484859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:19.485350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.487359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.497219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 63/115] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.498424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.520995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb774abb-c85b-45e1-afba-2731779a2efe admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.526664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.527409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.527708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.528001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.529000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] RBAC: Adding query filter params (role.id=3150c0f2273e4c698c3699aee70e5eb1, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=57d2a3fd5e6a4ce2952daaf06db362ce) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:19.529319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.531527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.532753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 53/116] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:19.533858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.547768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 64/117] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/role_assignments?user.id=57d2a3fd5e6a4ce2952daaf06db362ce&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=3150c0f2273e4c698c3699aee70e5eb1 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.553234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77bae6-1979-477c-9955-4078b7cdad83 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.559082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.560494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.560975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.561430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.562974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.565549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.567804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 54/118] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.573906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.589371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80bc94-59bc-4d8e-b3c2-2eaf392a197c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.592951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.617888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.619412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.620095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.622537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] PATH_INFO: `/v3/projects/e2fea86a25934d008586c9b51f530873` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.623824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841d90a-fdf8-43d7-ba34-3864a9ad8199 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.629558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fea86a25934d008586c9b51f530873)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.634659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.641274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 65/119] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/projects/e2fea86a25934d008586c9b51f530873 => generated 312 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.642212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.643330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.643797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.644306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.645885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.647749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.650045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.656850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 55/120] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:19.662415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8af21b-5199-4c6d-8acc-e13c37ea0d8e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.664247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:19.684448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.685462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.685751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.686033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] PATH_INFO: `/v3/projects/e2fea86a25934d008586c9b51f530873/users/8e0324dddc2245d1a18abd9fe6173b2b/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.690693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fea86a25934d008586c9b51f530873, user_id=8e0324dddc2245d1a18abd9fe6173b2b, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.691281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab0cce-b957-41c4-9528-728ee402a588 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:19.691761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:19.691761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:19.691761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:19.693875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdc16b-245c-4238-b2e6-49773a2c7a55 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.705848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106207-73c2-49cf-9efd-ad9f53eb4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:19.706456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106207-73c2-49cf-9efd-ad9f53eb4f77 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.706796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106207-73c2-49cf-9efd-ad9f53eb4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.707077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106207-73c2-49cf-9efd-ad9f53eb4f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.707863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106207-73c2-49cf-9efd-ad9f53eb4f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:19.709989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106207-73c2-49cf-9efd-ad9f53eb4f77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:19.826430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 66/121] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:19 2022] PUT /identity/v3/projects/e2fea86a25934d008586c9b51f530873/users/8e0324dddc2245d1a18abd9fe6173b2b/roles/246514336b4549609174329cae41663a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:19.856740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 56/122] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:13:19 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:19.995953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a84c-fa28-4558-9228-d4445b30e46e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:19.996491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a84c-fa28-4558-9228-d4445b30e46e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:19.996491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a84c-fa28-4558-9228-d4445b30e46e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:19.998558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 67/123] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:20.000286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ece9-47db-4a52-b79e-beafd5db489f None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.000739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ece9-47db-4a52-b79e-beafd5db489f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.000900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ece9-47db-4a52-b79e-beafd5db489f None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.004318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.008806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.009165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.011114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 57/124] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:20.015453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.015777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.016014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.047269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:20.052703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:20.077975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:20.079385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:20.181073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 58/125] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:20.194718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 68/126] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:20.206819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.216803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af06b4-9ae5-4992-90c9-3c3bf7517deb None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.224482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.224634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.224758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.224758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.224758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.236314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:20.240167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f4c0-954a-49c8-a43e-b59039ba3139 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.244534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:20.246397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 59/127] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:20.252190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.258295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.259318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.259834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.260317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.263639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfe08c-c263-4051-a2e7-1d278e56a390 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.268881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.270472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.270472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.270472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.271004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:20.271318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.273833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.275930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:20.282893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 60/128] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:20.283915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:20.285385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 69/129] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:20.289019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.291687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.300148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ea1c-65c1-46eb-9b4a-fecb7b77b00c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.302772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef361d9e-a55e-478d-bdd3-15bb087c0cca admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.305076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.306037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.306419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.306714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.308039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.309197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.310317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.311020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.311559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.311889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 61/130] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:20.312315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.313428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:20.313938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.315869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.317129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.327045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 70/131] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:20.331545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1428a1-6c4a-405f-b430-08b82b815d51 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.333024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.333145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.334080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.334365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.334735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.336515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.338599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.341269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 62/132] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:20.348007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ba99-472c-4bdb-9b3d-2cdbc74519e7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.349347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.352658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.353533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.353826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.354110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.355312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.357976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.360461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 71/133] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:20.365503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444c3e-7105-4c34-b6da-c70bcf76713f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.367519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.370540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9f92a-ef89-4f4d-9ec4-9766378b914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.371489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f92a-ef89-4f4d-9ec4-9766378b914e admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.371849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f92a-ef89-4f4d-9ec4-9766378b914e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.372222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f92a-ef89-4f4d-9ec4-9766378b914e admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/8e0324dddc2245d1a18abd9fe6173b2b/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.374832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9f92a-ef89-4f4d-9ec4-9766378b914e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2abaf64745eb9e2eac4926e4870d, user_id=8e0324dddc2245d1a18abd9fe6173b2b, role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.378504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9f92a-ef89-4f4d-9ec4-9766378b914e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.380176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a367a-5ad1-483f-98aa-fd167141b9af admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.388953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.389434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.389919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.389919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.393268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.395604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.405735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 72/134] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:20 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:20.405735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:20.414601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9617a-b44d-49a6-bf49-2e0dee407bbd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:20.419360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2ab12-b3b6-407d-b39a-a067f1af0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:20.420282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ab12-b3b6-407d-b39a-a067f1af0fed admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:20.420712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ab12-b3b6-407d-b39a-a067f1af0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:20.421039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ab12-b3b6-407d-b39a-a067f1af0fed admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/1f7f9c623a1f47c79a8fa4a52a1af83b/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:20.423153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2ab12-b3b6-407d-b39a-a067f1af0fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2abaf64745eb9e2eac4926e4870d, user_id=1f7f9c623a1f47c79a8fa4a52a1af83b, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:20.426201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2ab12-b3b6-407d-b39a-a067f1af0fed admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:20.459184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 63/135] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:20 2022] PUT /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/8e0324dddc2245d1a18abd9fe6173b2b/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:20.506403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 73/136] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:20 2022] PUT /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/1f7f9c623a1f47c79a8fa4a52a1af83b/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:13:22.749783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86897f7-bdc8-4ccc-928f-6392c2c2e80e None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:22.750320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86897f7-bdc8-4ccc-928f-6392c2c2e80e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:22.750320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86897f7-bdc8-4ccc-928f-6392c2c2e80e None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:22.752399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 64/137] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:22.758777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:22.759252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:22.759327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:22.789509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:22.790712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:22.867669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 74/138] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:22.907747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86897f7-bdc8-4ccc-928f-6392c2c2e80e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:22.922967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86897f7-bdc8-4ccc-928f-6392c2c2e80e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:22.933869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:22.934677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:22.934960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:22.935237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:22.948392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:22.955302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:22.956523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 65/139] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:22.962459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:22.971462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c591d38-cad5-461c-8de2-104102df8be2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:22.980526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:22.981208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:22.981489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:22.981767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:22.982527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:22.982834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:22.984468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:22.994181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 75/140] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:22.999961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.013858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17287005-4f8a-4871-b322-8c69f4ef9d19 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.020584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.021448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.021736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.022012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.023252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.025423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.026996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 66/141] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:22 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.032495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.042622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540051ed-cb63-4d4c-bf44-d49b09a0234f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.054754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.055446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.055749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.056024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.065372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.067249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.078047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 76/142] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:23.083958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.095465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f2437-0555-4ce3-ae53-477bbb38947a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.104538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6e1b-d1a2-42bb-aff9-c80856b80629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.105396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6e1b-d1a2-42bb-aff9-c80856b80629 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.105680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6e1b-d1a2-42bb-aff9-c80856b80629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.105955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6e1b-d1a2-42bb-aff9-c80856b80629 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.107209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6e1b-d1a2-42bb-aff9-c80856b80629 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.109394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6e1b-d1a2-42bb-aff9-c80856b80629 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.111216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 67/143] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.117567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.127295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e73c-ffdf-4a88-9706-45f8065afb54 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.136480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.137379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.137700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.138039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.138877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=8e0324dddc2245d1a18abd9fe6173b2b) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:23.139183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.141081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12aabb-61bf-4290-be6f-04c1851eb10d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.147462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 77/144] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/role_assignments?user.id=8e0324dddc2245d1a18abd9fe6173b2b&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=246514336b4549609174329cae41663a => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.151402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e172-f89b-4bba-90c9-41b9b4995b5e None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.151402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e172-f89b-4bba-90c9-41b9b4995b5e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.151402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e172-f89b-4bba-90c9-41b9b4995b5e None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.152941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 68/145] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:23.158922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.159213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.159466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.185896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:23.187179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:23.199771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 78/146] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:23.242998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e172-f89b-4bba-90c9-41b9b4995b5e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.262399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e172-f89b-4bba-90c9-41b9b4995b5e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.270830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990a73-6cb9-448b-b248-3bb16167831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.271646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a73-6cb9-448b-b248-3bb16167831b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.271928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a73-6cb9-448b-b248-3bb16167831b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.272234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a73-6cb9-448b-b248-3bb16167831b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.291924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c990a73-6cb9-448b-b248-3bb16167831b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:23.299382 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0c990a73-6cb9-448b-b248-3bb16167831b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:23.300669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 69/147] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:23.306721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.320897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32760a69-af9b-4262-b4f1-4f8a45f23890 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.327912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64169fb-82c8-46b6-a0b5-f55d33b0f7f7 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.328526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64169fb-82c8-46b6-a0b5-f55d33b0f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.329024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64169fb-82c8-46b6-a0b5-f55d33b0f7f7 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.331157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 70/148] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:23.333903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.339178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.339178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.339178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.339178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:23.339178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.339628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.339628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.339628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.339840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.353669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 79/149] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.359703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.363049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:23.364473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:23.372659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 71/150] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:23.374042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fcee3-703a-44e0-ac84-42140c9d29ed admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.380618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.382453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.382972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.383454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] PATH_INFO: `/v3/users/57d2a3fd5e6a4ce2952daaf06db362ce` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.385033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] RBAC: Authorizing `identity:get_user(user_id=57d2a3fd5e6a4ce2952daaf06db362ce)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.387610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.389744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 80/151] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/users/57d2a3fd5e6a4ce2952daaf06db362ce => generated 289 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:23.395422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.405592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb533a-a72d-47d7-b5d6-ee1d56ccc747 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.410461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.411595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.412108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.414024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.414919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.416271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.418541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.420601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 72/152] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.428554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e36268-3dca-4c02-8759-4e5c1992253b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.433295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.434355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.434844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.435327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.440103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.448479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:23.454532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ac704-b22d-4186-8f5b-350833e301ae admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.455574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:23.456815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 81/153] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:23.464597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.465571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d39ca-06a8-4b79-917b-bee9851e9d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.466466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d39ca-06a8-4b79-917b-bee9851e9d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.466748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d39ca-06a8-4b79-917b-bee9851e9d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.467027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d39ca-06a8-4b79-917b-bee9851e9d70 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/57d2a3fd5e6a4ce2952daaf06db362ce/roles/3150c0f2273e4c698c3699aee70e5eb1` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.469025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d39ca-06a8-4b79-917b-bee9851e9d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2abaf64745eb9e2eac4926e4870d, user_id=57d2a3fd5e6a4ce2952daaf06db362ce, role_id=3150c0f2273e4c698c3699aee70e5eb1)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.471702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d39ca-06a8-4b79-917b-bee9851e9d70 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.476281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005fd1-a02b-4547-a526-7d0e00c4b9a0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.481027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.487760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.487760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.487760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.487760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:23.487760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.487760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.499647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 82/154] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:23.505323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.517991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533deba2-4ba8-43b6-a6d9-558c74af746b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.524939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206cf3e-5158-4cce-a025-f46dadb5520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.528574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206cf3e-5158-4cce-a025-f46dadb5520d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.528574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206cf3e-5158-4cce-a025-f46dadb5520d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.528574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206cf3e-5158-4cce-a025-f46dadb5520d admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.528574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206cf3e-5158-4cce-a025-f46dadb5520d admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.530645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206cf3e-5158-4cce-a025-f46dadb5520d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.532306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 83/155] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:23.533535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41333e8e-a4b3-4026-aded-5f4d93685e4d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.533803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41333e8e-a4b3-4026-aded-5f4d93685e4d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.534076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41333e8e-a4b3-4026-aded-5f4d93685e4d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.535722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 84/156] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:23.540417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41333e8e-a4b3-4026-aded-5f4d93685e4d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.553779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41333e8e-a4b3-4026-aded-5f4d93685e4d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.562869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 73/157] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:23 2022] PUT /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/users/57d2a3fd5e6a4ce2952daaf06db362ce/roles/3150c0f2273e4c698c3699aee70e5eb1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:13:23.568831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.568831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.568831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.596846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:23.598071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:23.657984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.658570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.658851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.659126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.676485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.678320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.693889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 85/158] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:23.699759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.711078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 74/159] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:23.723079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a830-d329-40a2-92e3-1208f141c3d5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.735464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.738676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.739557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.739849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.740127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] PATH_INFO: `/v3/projects/e2fea86a25934d008586c9b51f530873` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.745287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fea86a25934d008586c9b51f530873)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.746213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce455da-a94a-46d6-95f1-b445a4e57384 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.747423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.749549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 86/160] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/projects/e2fea86a25934d008586c9b51f530873 => generated 312 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.752182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.753771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.754269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.754790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.755706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.756598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.758754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.760692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 75/161] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:23.766625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.770968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa930-0fdc-4bd4-9078-10646bd0666f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.778507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85b7c-b78f-484a-bf8b-be986a0d979e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.783508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.784533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.785084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.785567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.786518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.786621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.787213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.787487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.787764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.788730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, scope.project.id=e2fea86a25934d008586c9b51f530873, user.id=8e0324dddc2245d1a18abd9fe6173b2b) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:23.789067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.790429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.790937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbf157-4ace-4ed6-99d8-af7a9ee6257b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.799010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 87/162] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/role_assignments?user.id=8e0324dddc2245d1a18abd9fe6173b2b&scope.project.id=e2fea86a25934d008586c9b51f530873&role.id=246514336b4549609174329cae41663a => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:23.803371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd62b5-cfd1-4ce6-8f65-efc1c0c7629a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.804454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd62b5-cfd1-4ce6-8f65-efc1c0c7629a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.804581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd62b5-cfd1-4ce6-8f65-efc1c0c7629a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.806336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 88/163] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:23.813648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.813932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.814207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.840246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:23.841491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:23.850503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 89/164] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:23.879599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.889108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 76/165] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:23 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:13:23.898396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1166b8-6031-4414-93f6-fd60790cb8f5 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.903530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.904588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.904965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.905242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.919241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:23.926858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:23.928211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 90/166] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:23.934535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.945450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96db7-85bf-42db-b7c2-379a0cc3bc93 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.950289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.951073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.951357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.951633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.952471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:23.952787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.954516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:23.964940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 77/167] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:23.970864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:23.982100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137635-fe84-4410-b544-1bd91d39fb0a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:23.991548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:23.992540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:23.992873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:23.993145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] PATH_INFO: `/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:23.996704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7f9c623a1f47c79a8fa4a52a1af83b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:23.998776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.000941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 91/168] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:23 2022] GET /identity/v3/users/1f7f9c623a1f47c79a8fa4a52a1af83b => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:24.007272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.017996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ec87a-e95c-4451-ab31-777be7b82601 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.023370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.024037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.024369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.024689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.034406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.036334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.046446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 78/169] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:24.052085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.063795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76e13-0964-4f9b-a2c4-3425d59b40c5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.069562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae797cc-aad8-4928-8c8b-6da6a5e4e447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.070441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae797cc-aad8-4928-8c8b-6da6a5e4e447 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.070718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae797cc-aad8-4928-8c8b-6da6a5e4e447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.070988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae797cc-aad8-4928-8c8b-6da6a5e4e447 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.072249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae797cc-aad8-4928-8c8b-6da6a5e4e447 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.074424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae797cc-aad8-4928-8c8b-6da6a5e4e447 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.076265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 92/170] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:24.082309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.091661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0670-3d2e-423d-a0a9-72f0bd29d8ef admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.096337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.097065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.097344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.097617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.098590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=1f7f9c623a1f47c79a8fa4a52a1af83b) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:24.098901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.101374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322870e-d931-4c27-bca4-5aa923f7b1f4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.112849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 79/171] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/role_assignments?user.id=1f7f9c623a1f47c79a8fa4a52a1af83b&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:24.506046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0e6c7-9452-4f62-9028-f61e465d589f None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.506434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0e6c7-9452-4f62-9028-f61e465d589f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.506660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0e6c7-9452-4f62-9028-f61e465d589f None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.508680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 93/172] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:24.514203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878926c3-0976-41d1-af57-f984292ed73a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.514492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878926c3-0976-41d1-af57-f984292ed73a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.514761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878926c3-0976-41d1-af57-f984292ed73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.534966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-878926c3-0976-41d1-af57-f984292ed73a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:24.536148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-878926c3-0976-41d1-af57-f984292ed73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:24.547340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 80/173] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:24.571195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0e6c7-9452-4f62-9028-f61e465d589f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.587147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0e6c7-9452-4f62-9028-f61e465d589f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.592179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.593004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.593285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.593556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.607949 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:24.615311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:24.616610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 94/174] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:24.622376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878926c3-0976-41d1-af57-f984292ed73a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.631921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878926c3-0976-41d1-af57-f984292ed73a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.636409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.637319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.637694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.638061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.638907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:24.639307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.641134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.656116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 81/175] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:24.661696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.675006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127816-3d32-4833-bbf3-ac63a3595f33 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.685936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.686811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.687095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.687370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] PATH_INFO: `/v3/users/8e0324dddc2245d1a18abd9fe6173b2b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.693171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] RBAC: Authorizing `identity:get_user(user_id=8e0324dddc2245d1a18abd9fe6173b2b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.695386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.697020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 95/176] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/users/8e0324dddc2245d1a18abd9fe6173b2b => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:24.702752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.716759 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4726e-a64f-4b62-9dd1-51697d60d618 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.723907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.724584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.724865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.725140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.733880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.735618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.753358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 82/177] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:24.760092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.778361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1e2c5-9bb8-4292-b3fe-5979226318dc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.793111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5058ab8-07d7-4355-b281-50d5cdf6639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.793945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5058ab8-07d7-4355-b281-50d5cdf6639f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.794223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5058ab8-07d7-4355-b281-50d5cdf6639f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.794496 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5058ab8-07d7-4355-b281-50d5cdf6639f admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.795717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5058ab8-07d7-4355-b281-50d5cdf6639f admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.797811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5058ab8-07d7-4355-b281-50d5cdf6639f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.799783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 96/178] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:24.805948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:24.819557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341730c-50d0-4861-a784-da32a7b0435c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:24.823925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:24.824612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:24.824890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:24.825167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:24.826043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] RBAC: Adding query filter params (role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=8e0324dddc2245d1a18abd9fe6173b2b) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:24.826363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:24.828218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a36ed-3b96-47d6-9f76-ac5532cc32ee admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:24.840480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 83/179] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:24 2022] GET /identity/v3/role_assignments?user.id=8e0324dddc2245d1a18abd9fe6173b2b&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.090952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceed9b-2671-464f-a4f0-5c86a6428fa4 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.091469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceed9b-2671-464f-a4f0-5c86a6428fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.091469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceed9b-2671-464f-a4f0-5c86a6428fa4 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.093216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 97/180] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:26.098510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680879de-e5d5-4036-861f-500c7111e977 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.098912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680879de-e5d5-4036-861f-500c7111e977 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.099097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680879de-e5d5-4036-861f-500c7111e977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.117832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-680879de-e5d5-4036-861f-500c7111e977 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:26.119015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-680879de-e5d5-4036-861f-500c7111e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:26.127129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 84/181] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:26.155121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceed9b-2671-464f-a4f0-5c86a6428fa4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.167998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceed9b-2671-464f-a4f0-5c86a6428fa4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.172247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.173058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.173337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.173610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.184164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:26.191231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:26.196823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 98/182] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:26.198503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680879de-e5d5-4036-861f-500c7111e977 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.207456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680879de-e5d5-4036-861f-500c7111e977 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.212619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.213273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.213559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.213827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.214570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:26.214871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.216487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.224988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 85/183] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.231055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.240857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696410b-2d0d-4705-8229-51b90ace3212 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.245165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.246023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.246307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.246576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] PATH_INFO: `/v3/users/57d2a3fd5e6a4ce2952daaf06db362ce` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.247762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] RBAC: Authorizing `identity:get_user(user_id=57d2a3fd5e6a4ce2952daaf06db362ce)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.251490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.253127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 99/184] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/users/57d2a3fd5e6a4ce2952daaf06db362ce => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.259248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.269425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184d11-3a20-4aa1-9aa2-07a485fc9085 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.274707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.275381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.275660 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.275935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.284750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.286552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.296341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 86/185] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:26.301972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.312271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bb40f-1abf-4ca4-ab3c-bbf3e5c14a68 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.316578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557503-2f57-4288-97e7-5935ed2adbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.317410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557503-2f57-4288-97e7-5935ed2adbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.317690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557503-2f57-4288-97e7-5935ed2adbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.317963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557503-2f57-4288-97e7-5935ed2adbd9 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.319868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557503-2f57-4288-97e7-5935ed2adbd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.321960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557503-2f57-4288-97e7-5935ed2adbd9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.323817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 100/186] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.329590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.339147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb820b4-3646-4564-af1a-d4ab3fe78c77 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.343533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.344118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.344398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.344704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.345566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] RBAC: Adding query filter params (role.id=3150c0f2273e4c698c3699aee70e5eb1, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d, user.id=57d2a3fd5e6a4ce2952daaf06db362ce) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:26.345874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.347719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839609b-699c-4de1-8461-509eecba253d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.353955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 87/187] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/role_assignments?user.id=57d2a3fd5e6a4ce2952daaf06db362ce&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=3150c0f2273e4c698c3699aee70e5eb1 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.639787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab998c6-28cd-4b5a-8beb-4a633cbbfa8e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.640082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab998c6-28cd-4b5a-8beb-4a633cbbfa8e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.640362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab998c6-28cd-4b5a-8beb-4a633cbbfa8e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.642350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 101/188] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:26.647374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.647661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.647936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.665209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:26.666370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:26.676459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 88/189] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:26.700354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab998c6-28cd-4b5a-8beb-4a633cbbfa8e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.712481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab998c6-28cd-4b5a-8beb-4a633cbbfa8e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.716681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.717507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.717787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.718148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.728901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:26.735911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:26.737267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 102/190] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:26.743339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.752468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abbbb-a29d-43d7-801d-6b063cacfe99 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.757357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.758009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.758286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.758555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.759298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:26.759600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.761237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.769622 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 89/191] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.774969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.784676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76726dc5-238a-45e5-9582-abb220e49d9d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.789068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.789923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.790208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.790487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] PATH_INFO: `/v3/users/195a6663cd3146b89ea22bc743e661e4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.804675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] RBAC: Authorizing `identity:get_user(user_id=195a6663cd3146b89ea22bc743e661e4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.806840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.808765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 103/192] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/users/195a6663cd3146b89ea22bc743e661e4 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.813894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.824069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b83c1-203b-4a92-95d3-7c9481debd46 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.828355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.829033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.829323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.829593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.837217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.838965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.847696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 90/193] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:26.853031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.866513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e397fc-1635-45c8-abe1-cbff6f7072da admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.870964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb22de8-4e25-4118-b2ed-352eab9f091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.871771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22de8-4e25-4118-b2ed-352eab9f091c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.872065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22de8-4e25-4118-b2ed-352eab9f091c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.872405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22de8-4e25-4118-b2ed-352eab9f091c admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.873632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb22de8-4e25-4118-b2ed-352eab9f091c admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.875967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb22de8-4e25-4118-b2ed-352eab9f091c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.877893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 104/194] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.884181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.893033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f89d8-7deb-4eec-8596-9d15443df837 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.897432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.898147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.898433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.898706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.899586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=195a6663cd3146b89ea22bc743e661e4) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:26.900352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.901549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f406a-10f4-4a9f-bb74-603f98b02c41 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.901897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f406a-10f4-4a9f-bb74-603f98b02c41 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.902179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f406a-10f4-4a9f-bb74-603f98b02c41 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.902268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee5c6-d090-4627-9856-151feac2ccac admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.904282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 105/195] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:26.908488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 91/196] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/role_assignments?user.id=195a6663cd3146b89ea22bc743e661e4&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:26.909213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.909497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.909775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.914784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde4ec-3d32-43f1-9fd5-7d37e3ef8851 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.915066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde4ec-3d32-43f1-9fd5-7d37e3ef8851 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.915360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde4ec-3d32-43f1-9fd5-7d37e3ef8851 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.917941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 92/197] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:26.923481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.923817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.924027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.929328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:26.930539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:26.938383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 106/198] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:26.943367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:26.945201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:26.952724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 93/199] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:26.963008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.972377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1bca1-11df-4a9f-8e62-aa98e3b4fc60 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.976829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.977170 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.977982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.978258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.978525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.979723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:26.981472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:26.983338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 107/200] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:26.985980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5666f7-00c6-44db-8138-2c5f337247a8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:26.988672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:26.991403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:26.992235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:26.992557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:26.992831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:26.999071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7609c-07a5-41f8-8f77-360cd3a58808 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:27.004064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:27.004584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:27.004776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:27.005056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:27.005332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:27.006052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:27.007666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:27.007666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:27.007666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:27.008947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:27.013274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:27.014707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 94/201] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:27.020457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:27.030524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827a11-65d0-4e10-b1f2-7df508a6798a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:27.034933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:27.040472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:27.040472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:27.040472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:27.040472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:27.040472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:27.040472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:27.048737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 95/202] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:27.055133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:27.064970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f477-b0fa-4157-bc8d-63284a67ccc9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:27.069243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:27.070131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:27.070466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:27.070740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] PATH_INFO: `/v3/users/195a6663cd3146b89ea22bc743e661e4` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:27.072076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=195a6663cd3146b89ea22bc743e661e4)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:27.074290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:27.075993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 96/203] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:27 2022] GET /identity/v3/users/195a6663cd3146b89ea22bc743e661e4 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:27.081679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:27.091248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf5b2-a110-481f-b46e-527d57baf0d9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:27.095931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:27.096596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:27.097780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:27.097780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:27.099774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 108/204] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:26 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:13:27.106221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:27.108013 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:27.118794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 97/205] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:27.125363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:27.135960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51693635-73ea-4d66-ae82-e6f3c7a61395 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:27.140832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0eeda-ce70-4a68-ad06-082fbff5cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:27.141711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0eeda-ce70-4a68-ad06-082fbff5cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:27.141990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0eeda-ce70-4a68-ad06-082fbff5cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:27.142310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0eeda-ce70-4a68-ad06-082fbff5cdfd admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:27.143693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0eeda-ce70-4a68-ad06-082fbff5cdfd admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:27.145942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0eeda-ce70-4a68-ad06-082fbff5cdfd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:27.147945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 109/206] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:27 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:27.154094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:27.164181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d452d-f83d-4a4c-b8b7-a5f2c815d9a7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:27.168893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:27.169565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:27.169848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:27.170285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:27.171031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] RBAC: Adding query filter params (role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=195a6663cd3146b89ea22bc743e661e4) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:27.171344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:27.173280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe7e76-f933-43d6-949a-a58a91a540f1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:27.183855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 98/207] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:27 2022] GET /identity/v3/role_assignments?user.id=195a6663cd3146b89ea22bc743e661e4&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.250887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04b70-beb0-4002-a5ea-9ec226a4f656 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.251407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04b70-beb0-4002-a5ea-9ec226a4f656 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.251407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04b70-beb0-4002-a5ea-9ec226a4f656 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.253403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 110/208] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:29.260150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.260643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.260966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.283172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:29.284539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:29.292250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 99/209] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:29.315208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04b70-beb0-4002-a5ea-9ec226a4f656 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.328275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04b70-beb0-4002-a5ea-9ec226a4f656 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.332851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.333763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.334152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.335175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.346522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:29.353718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:29.355208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 111/210] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:29.360774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.370221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15982-32d3-4730-82e0-833a20095ea9 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.375014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.375962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.376350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.376753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.377616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:29.378020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.379709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.388883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 100/211] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.394246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.405576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edb62-224f-4382-b2f0-5ed9b844c00e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.410284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.411246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.411632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.412011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] PATH_INFO: `/v3/users/195a6663cd3146b89ea22bc743e661e4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.413394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] RBAC: Authorizing `identity:get_user(user_id=195a6663cd3146b89ea22bc743e661e4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.415634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.417375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 112/212] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/users/195a6663cd3146b89ea22bc743e661e4 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.422726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.432616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8aedf5-e8b5-4faa-b04d-44bc168d4f30 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.437312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbc37f-8611-4df9-a7ed-d6ece0996365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.438259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc37f-8611-4df9-a7ed-d6ece0996365 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.438643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc37f-8611-4df9-a7ed-d6ece0996365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.439022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc37f-8611-4df9-a7ed-d6ece0996365 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.440330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbc37f-8611-4df9-a7ed-d6ece0996365 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.442508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbc37f-8611-4df9-a7ed-d6ece0996365 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.445015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 101/213] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.450544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.461331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681a97-fc3c-4b36-89da-e9b3208f9824 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.465931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.466914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.467300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.467679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/195a6663cd3146b89ea22bc743e661e4/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.469813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3b9d050f2413391d4df1ea6733255, user_id=195a6663cd3146b89ea22bc743e661e4, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.470293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a774c-052c-4275-9c0f-4f764ec6b7ec None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.470583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a774c-052c-4275-9c0f-4f764ec6b7ec None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.470861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a774c-052c-4275-9c0f-4f764ec6b7ec None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.472898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 102/214] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:29.473010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.477864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.478146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.478416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.495754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:29.496954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:29.504964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 103/215] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:29.527874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.536747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e32f-cb71-4d47-9839-25c42711de3e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.542333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b4226-52bc-464d-af10-9dedf45d7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.543555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4226-52bc-464d-af10-9dedf45d7673 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.543983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4226-52bc-464d-af10-9dedf45d7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.544494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4226-52bc-464d-af10-9dedf45d7673 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.545625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 113/216] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:29 2022] PUT /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/195a6663cd3146b89ea22bc743e661e4/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:29.558751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b4226-52bc-464d-af10-9dedf45d7673 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:29.566519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-fa8b4226-52bc-464d-af10-9dedf45d7673 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:29.567949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 104/217] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:29.574582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.601970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282867a-cb48-478c-bc05-241638e0090c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.602353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282867a-cb48-478c-bc05-241638e0090c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.602730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282867a-cb48-478c-bc05-241638e0090c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.604810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 105/218] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:29.610287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6bf28-08b9-43fa-8bfe-7d1ccc94b326 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.610582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6bf28-08b9-43fa-8bfe-7d1ccc94b326 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.610856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6bf28-08b9-43fa-8bfe-7d1ccc94b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.630432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-11d6bf28-08b9-43fa-8bfe-7d1ccc94b326 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:29.632192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-11d6bf28-08b9-43fa-8bfe-7d1ccc94b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:29.644399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd12c-490f-47ea-9e9a-70de53c54e29 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.648980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.649667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.649951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.650227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.650987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:29.651295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.652992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d3fd8-4fca-4a65-85cc-ea370dda325b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.661883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 114/219] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.666032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398092d3-df8b-4f2e-b864-e77f932dcc4d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.666667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398092d3-df8b-4f2e-b864-e77f932dcc4d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.666947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398092d3-df8b-4f2e-b864-e77f932dcc4d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.669383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 115/220] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:29.673674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398092d3-df8b-4f2e-b864-e77f932dcc4d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.686385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398092d3-df8b-4f2e-b864-e77f932dcc4d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.691523 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.692405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.692723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.692998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] PATH_INFO: `/v3/users/195a6663cd3146b89ea22bc743e661e4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.694787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] RBAC: Authorizing `identity:get_user(user_id=195a6663cd3146b89ea22bc743e661e4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.697017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.700847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 106/221] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:29.701012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 116/222] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/users/195a6663cd3146b89ea22bc743e661e4 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.701088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.701088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.701088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.710158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.720069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd9722-e9fb-4ee9-9ac9-13ad45a4823f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.725815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.726779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.727134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.727476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.728375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:29.728874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.729603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:29.731104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.734084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 117/223] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:29.735237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.743345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 107/224] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:29.744463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.747023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bffe84-6773-41da-b132-a87ec7a1995d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.751694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.752538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.752832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.753107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.755164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99d79-a404-491e-bbcd-1df30f72e7ab None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.762697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.763571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.763904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.764123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/195a6663cd3146b89ea22bc743e661e4/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.765801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:29.766498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3b9d050f2413391d4df1ea6733255, user_id=195a6663cd3146b89ea22bc743e661e4, role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.769211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.773113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:29.774325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 118/225] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:29.775134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.786533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c34ae7-02b1-4a60-b638-a96cef3aaa50 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.790789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.791517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.791794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.792063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.793229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.794944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.796512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 119/226] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.797291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.807109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526c17-04ba-43f0-887e-67e184f25780 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.811247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.811877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.812158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.812449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.813212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:29.815921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.815921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.823797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 120/227] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.828240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.837028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06ef04-0b83-4603-a6c1-231bf086ebb3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.841293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.841915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.842195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.842467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.843158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.845080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.847227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 108/228] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:29 2022] PUT /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/195a6663cd3146b89ea22bc743e661e4/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:29.848182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.917928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3862a7-01b4-42e2-bcef-eae5a89e345a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.923358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.924386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.924947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.925449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] PATH_INFO: `/v3/users/fb6e16500d574a8b94b76cf53c84b1b0` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.942793 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] RBAC: Authorizing `identity:get_user(user_id=fb6e16500d574a8b94b76cf53c84b1b0)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.946085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.953572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 109/229] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/users/fb6e16500d574a8b94b76cf53c84b1b0 => generated 297 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:29.954530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:29.956116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 121/230] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:29 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:29.965735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860728-2cc6-4f53-8d8b-95ad58a9fd1c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:29.970464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:29.971134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:29.971416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:29.971689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:29.980779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:29.982614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:29.993816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 110/231] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:29.999833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:30.012062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b05403-1883-4547-969d-082fa9c28741 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:30.017018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcbcf-8188-46f4-bf01-99ed5ccf7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:30.017915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcbcf-8188-46f4-bf01-99ed5ccf7487 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:30.018239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcbcf-8188-46f4-bf01-99ed5ccf7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:30.018520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcbcf-8188-46f4-bf01-99ed5ccf7487 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:30.019961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcbcf-8188-46f4-bf01-99ed5ccf7487 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:30.022286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcbcf-8188-46f4-bf01-99ed5ccf7487 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:30.024440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 122/232] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:29 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:30.030610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:30.042288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cf300-41df-4402-9205-cc53935ffbd4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:30.047353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:30.048084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:30.048414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:30.048813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:30.049672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=fb6e16500d574a8b94b76cf53c84b1b0) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:30.049985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:30.052040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a113e47-7c0b-4be2-80e0-61d38cd5310f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:30.059376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 111/233] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:30 2022] GET /identity/v3/role_assignments?user.id=fb6e16500d574a8b94b76cf53c84b1b0&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=246514336b4549609174329cae41663a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:32.532684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f9a31-4d67-4e83-aacf-4e04f9239abe None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.533190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f9a31-4d67-4e83-aacf-4e04f9239abe None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.533296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f9a31-4d67-4e83-aacf-4e04f9239abe None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.535361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 123/234] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:32.541569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.542060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.542130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.560343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:32.561596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:32.576605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 112/235] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:32.595391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f9a31-4d67-4e83-aacf-4e04f9239abe None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.608501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f9a31-4d67-4e83-aacf-4e04f9239abe None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.613879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.614688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.614966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.615240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.628601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:32.636280 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:32.637903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 124/236] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:32.643593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.652738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c854796-d623-4580-bdd4-0a1860beafbe None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.657187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.657853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.658132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.658405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.659157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:32.659464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:32.661106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:32.670344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 113/237] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:32.679924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.690796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7dbf-6364-4eff-9b17-d3cc07efbb16 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.702254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6774a8-8607-4b33-9e53-cb9b644d8924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.703138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6774a8-8607-4b33-9e53-cb9b644d8924 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.703422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6774a8-8607-4b33-9e53-cb9b644d8924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.703695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6774a8-8607-4b33-9e53-cb9b644d8924 admin admin] PATH_INFO: `/v3/users/195a6663cd3146b89ea22bc743e661e4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.709193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6774a8-8607-4b33-9e53-cb9b644d8924 admin admin] RBAC: Authorizing `identity:get_user(user_id=195a6663cd3146b89ea22bc743e661e4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:32.711570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6774a8-8607-4b33-9e53-cb9b644d8924 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:32.713427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 125/238] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/users/195a6663cd3146b89ea22bc743e661e4 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:32.719141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.728878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c5d15-d941-4b0b-ba5f-2683870f029b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.733371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.734011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.734294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.734570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.744936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d90fa-d744-4eae-8ed8-853cbef4f966 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.745213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d90fa-d744-4eae-8ed8-853cbef4f966 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.745491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d90fa-d744-4eae-8ed8-853cbef4f966 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.747267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 126/239] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:32.747829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:32.749994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:32.753176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.753462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.753737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.775617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 114/240] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:32.784067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:32.785225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:32.786868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.799592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824309dc-5eb6-4335-bf22-abc0ca5bf851 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.802762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 127/241] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 21 01:13:32.812233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.813268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.813555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.813829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.815040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:32.817125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:32.818842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 115/242] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:32.825355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.835075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38aaf3-7abe-4886-96f9-acfcced49f12 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.854016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.854372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.854769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.854974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.855251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.856094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=195a6663cd3146b89ea22bc743e661e4) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:32.856405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:32.858305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd42f16-5ad0-4815-aa9f-f6171c043a7a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:32.864404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94fdd7-a20e-4f2d-8f3c-193e0af51595 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.869744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 128/243] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/role_assignments?user.id=195a6663cd3146b89ea22bc743e661e4&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:32.874604 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.875436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.875610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277662ef-2851-408b-8ec5-54cdb6e05c13 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.875774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.875990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277662ef-2851-408b-8ec5-54cdb6e05c13 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.876133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.876281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277662ef-2851-408b-8ec5-54cdb6e05c13 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.878039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 129/244] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:32.883842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.884131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.884416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.900044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:32.902555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:32.903761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:32.907387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:32.911806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 130/245] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:32.913800 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 116/246] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:32.918504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.934660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3a707-496b-437a-8782-733b4e2b667b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.945112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.945808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.946091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.946367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.947151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:32.947460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:32.949177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:32.957846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.964128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 131/247] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:32.972956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:32.979887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0befea-39fd-4d69-b378-1e226b4f1dd3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.989743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:32.991095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:32.991389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:32.991663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:32.994528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0673b8-8577-4a09-9fa8-e44ce12e58a3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:32.999222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c92bc-65e6-443b-98f9-b5d48a3982b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.000369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c92bc-65e6-443b-98f9-b5d48a3982b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.000734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c92bc-65e6-443b-98f9-b5d48a3982b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.001010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c92bc-65e6-443b-98f9-b5d48a3982b5 admin admin] PATH_INFO: `/v3/users/195a6663cd3146b89ea22bc743e661e4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.002297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c92bc-65e6-443b-98f9-b5d48a3982b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=195a6663cd3146b89ea22bc743e661e4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.004645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c92bc-65e6-443b-98f9-b5d48a3982b5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.006315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:33.006946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 132/248] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/users/195a6663cd3146b89ea22bc743e661e4 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:33.012334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0a251-b910-4d6c-84d5-63d6336bb59e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.012652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0a251-b910-4d6c-84d5-63d6336bb59e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.012936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0a251-b910-4d6c-84d5-63d6336bb59e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.014864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 133/249] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:33.019348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:33.019517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880cbaf-e58c-4e2b-aab5-ea70df75c851 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.019517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880cbaf-e58c-4e2b-aab5-ea70df75c851 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.019517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880cbaf-e58c-4e2b-aab5-ea70df75c851 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.019730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 117/250] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:33.019801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 134/251] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:33.019867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.024002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e001-bf3e-41aa-bd30-d1a59e9e7621 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.024654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e001-bf3e-41aa-bd30-d1a59e9e7621 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.024654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e001-bf3e-41aa-bd30-d1a59e9e7621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.029852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3a70-1ced-4473-b872-8b30d718a739 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.034282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.034956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.035453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.035781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.044256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fa22e001-bf3e-41aa-bd30-d1a59e9e7621 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:33.044819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.045492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fa22e001-bf3e-41aa-bd30-d1a59e9e7621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:33.046596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.053800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 135/252] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:33.055058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.055342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.055621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.061682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 118/253] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:33.061682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.074143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fd6-4519-455e-a47d-25db12a336a8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.076948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:33.078159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:33.079861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.080641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.080931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.081210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.081972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:33.082278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.083897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.086634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 136/254] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:33.088548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.094060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 119/255] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.098610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550849a2-ce47-45e2-8887-7943cf90b061 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.099480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.104047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.105192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.105619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.106080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.107527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.109858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.110669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961bef-6909-4ff7-b34e-db3c4afbafcd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.111934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 137/256] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.113131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.119866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.120730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.121012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.121290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.123900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93546d-ce83-4d08-aaba-69ec3e03d612 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.129461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.130315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.130595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.130863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] PATH_INFO: `/v3/users/fb6e16500d574a8b94b76cf53c84b1b0` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.132097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=fb6e16500d574a8b94b76cf53c84b1b0)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.132520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:33.134326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.135918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 138/257] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/users/fb6e16500d574a8b94b76cf53c84b1b0 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.136952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.139473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:33.140918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 120/258] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:33.141826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.147413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7bfe3-4936-4a13-b5bc-4b8defa2d4b8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.153109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.153109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.153109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.153109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.154264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.154635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eac62a-6e87-4661-acc7-3c7a4309d247 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.155955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.157716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 139/259] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.158389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.159173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.159770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.160053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.160330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.161212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] RBAC: Adding query filter params (role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=195a6663cd3146b89ea22bc743e661e4) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:33.161527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.163945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.169804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0d64-38fb-4255-9a05-1664bca72b59 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.172459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 121/260] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/role_assignments?user.id=195a6663cd3146b89ea22bc743e661e4&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.172805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.174367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.175214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.175498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.175774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.177048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.179800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.181833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 140/261] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.183162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.183305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d0ea-87d2-4506-a77b-69b91ff2e29e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.189322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.190011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.190319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.190591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.191360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:33.191676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.193366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.194294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9b3f-76af-40f7-8ac8-df732d49f9dd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.199106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.200127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.200638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.201088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.201960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.203175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 122/262] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.204380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.205243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.218426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e555-dc3f-4da6-9df5-de19378609a4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.223571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.224493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.224778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.225593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/fb6e16500d574a8b94b76cf53c84b1b0/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.228246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3b9d050f2413391d4df1ea6733255, user_id=fb6e16500d574a8b94b76cf53c84b1b0, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.230322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.305336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 141/263] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:33 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:33.313606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.324513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078c12-708f-40de-bc48-5a2be2de4a14 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.329610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.330779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.331242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.331668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] PATH_INFO: `/v3/users/74ffb5afc28e40abadde44124b68ed7f` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.351205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 123/264] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:33 2022] PUT /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/fb6e16500d574a8b94b76cf53c84b1b0/roles/246514336b4549609174329cae41663a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:33.352550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] RBAC: Authorizing `identity:get_user(user_id=74ffb5afc28e40abadde44124b68ed7f)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.354884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.356884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 142/265] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/users/74ffb5afc28e40abadde44124b68ed7f => generated 297 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.363008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.437875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc613a7-943a-431c-9479-9db733335fe8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.442608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.443285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.443563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.443866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.452986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.454857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.465831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 124/266] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:33.471828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.482781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b99e-c426-45f7-a98f-1e3b64ad6058 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.487428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8e987-d5c9-4809-91cc-fc69848e1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.488323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8e987-d5c9-4809-91cc-fc69848e1a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.488640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8e987-d5c9-4809-91cc-fc69848e1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.488910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8e987-d5c9-4809-91cc-fc69848e1a45 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.490300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8e987-d5c9-4809-91cc-fc69848e1a45 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.492509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8e987-d5c9-4809-91cc-fc69848e1a45 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.499745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 143/267] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:33.501342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:33.511501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98968ef-76dd-4b9e-bffb-8bfd865f8d3e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:33.516051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:33.516785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:33.517066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:33.517337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:33.518179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] RBAC: Adding query filter params (role.id=3150c0f2273e4c698c3699aee70e5eb1, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=74ffb5afc28e40abadde44124b68ed7f) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:33.518490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:33.520362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d16d-219a-4306-9d06-873d3ef10d16 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:33.527236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 125/268] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:33 2022] GET /identity/v3/role_assignments?user.id=74ffb5afc28e40abadde44124b68ed7f&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=3150c0f2273e4c698c3699aee70e5eb1 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:35.773810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c6f3e-4178-41d9-a885-608ad5321710 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.774847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c6f3e-4178-41d9-a885-608ad5321710 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.775342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c6f3e-4178-41d9-a885-608ad5321710 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.777625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 144/269] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:35.783461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4849-128a-42b4-ac5f-86d592c651d3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.784324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4849-128a-42b4-ac5f-86d592c651d3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.784934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4849-128a-42b4-ac5f-86d592c651d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.803858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-800f4849-128a-42b4-ac5f-86d592c651d3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:35.805399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-800f4849-128a-42b4-ac5f-86d592c651d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:35.813506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 126/270] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:35.820306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac75d-0843-415f-aa28-161c83235a31 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.820639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac75d-0843-415f-aa28-161c83235a31 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.820921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac75d-0843-415f-aa28-161c83235a31 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.822918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 145/271] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:35.827848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.828141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.828419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.846327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac75d-0843-415f-aa28-161c83235a31 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.848657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:35.850956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:35.859169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 127/272] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:35.860562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac75d-0843-415f-aa28-161c83235a31 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:35.864530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:35.865576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.866044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.866504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.877545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:35.883078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.885172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:35.886765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 146/273] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:35.892357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.893861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7e81-7d0f-48a9-9ec5-1ea99c55a7b6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:35.898980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:35.899868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.900248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.900667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.904454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5f90c-97f5-4ebb-b245-b2cb0ced8023 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:35.909010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:35.909669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.909955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.910232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.910985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:35.911293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:35.913498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c4f4d-b30a-4ce0-a674-f5f3c32dfdbf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:35.913606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:35.920902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:35.922197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 147/274] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:35.927573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 128/275] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:35.927738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e309cb9-890a-4492-b112-2a77a938fb72 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.927738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e309cb9-890a-4492-b112-2a77a938fb72 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.927738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e309cb9-890a-4492-b112-2a77a938fb72 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.927738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 148/276] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:35.928954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e309cb9-890a-4492-b112-2a77a938fb72 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.929175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.939084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96064d-183a-48cc-a170-8e7e06eb108b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:35.940882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e309cb9-890a-4492-b112-2a77a938fb72 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:35.943219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:35.943918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.944248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.944549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.945290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:35.945429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21936d39-03ec-4e54-af48-df08f228231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:35.945603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:35.946250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936d39-03ec-4e54-af48-df08f228231c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.946575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936d39-03ec-4e54-af48-df08f228231c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.946856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936d39-03ec-4e54-af48-df08f228231c admin admin] PATH_INFO: `/v3/users/fb6e16500d574a8b94b76cf53c84b1b0` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.947234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800c4ac-1b52-427f-bc23-71026272fab0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:35.948045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21936d39-03ec-4e54-af48-df08f228231c admin admin] RBAC: Authorizing `identity:get_user(user_id=fb6e16500d574a8b94b76cf53c84b1b0)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:35.950204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21936d39-03ec-4e54-af48-df08f228231c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:35.951793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 149/277] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/users/fb6e16500d574a8b94b76cf53c84b1b0 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:35.953000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.953293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.953569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.956182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 129/278] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:35.957446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941191-3395-41af-85fb-5a93a8c403c2 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.957731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941191-3395-41af-85fb-5a93a8c403c2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.958006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941191-3395-41af-85fb-5a93a8c403c2 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.960244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 130/279] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:35.960976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941191-3395-41af-85fb-5a93a8c403c2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.972488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941191-3395-41af-85fb-5a93a8c403c2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:35.974672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:35.976399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:35.977265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124f10c-7a02-414d-8bb4-cb2db9aa19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:35.977897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124f10c-7a02-414d-8bb4-cb2db9aa19eb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:35.978203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124f10c-7a02-414d-8bb4-cb2db9aa19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:35.978479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124f10c-7a02-414d-8bb4-cb2db9aa19eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:35.983654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 150/280] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:35.984478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:35.986744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124f10c-7a02-414d-8bb4-cb2db9aa19eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:35.988515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124f10c-7a02-414d-8bb4-cb2db9aa19eb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:35.993465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cdbff-ab3b-437a-9635-b3accd2a7748 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.000615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 131/281] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:36.000763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.000871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.000955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.001031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.001109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.001178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.001245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] PATH_INFO: `/v3/users/6464cd3104bd438d963eebd86b6f685d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.013261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] RBAC: Authorizing `identity:get_user(user_id=6464cd3104bd438d963eebd86b6f685d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.015423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.017111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 151/282] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:35 2022] GET /identity/v3/users/6464cd3104bd438d963eebd86b6f685d => generated 293 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:36.018052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.018420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:36.019599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:36.027578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 132/283] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:36.027880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcba60-66dc-4a24-9b6d-9bdfad90a215 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.028329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.032284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.033140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.033417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.033686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.034882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.036873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.037037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258bcb0-29ce-4cd0-af3e-a5c189eb7152 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.038700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 152/284] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:36.041307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.042073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.042356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.042633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.043912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.053064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f1a2d-9df8-4896-9881-797c4e54664d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.053232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:36.057293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.057898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.058180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.058453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.059261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, user.id=6464cd3104bd438d963eebd86b6f685d, scope.system=all) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:36.059571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.060141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:36.061320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 133/285] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:36.061528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.062072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.069685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 153/286] 10.222.0.90 () {56 vars in 1329 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/role_assignments?user.id=6464cd3104bd438d963eebd86b6f685d&scope.system=all&role.id=246514336b4549609174329cae41663a => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:36.070301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.072702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff4d4-cc5c-44ee-a4f2-cf8848492312 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.077288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.077961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.078247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.078524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.079370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=fb6e16500d574a8b94b76cf53c84b1b0) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:36.079682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.080053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02619780-5e85-434e-9aee-471ac6ab375d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.081625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.085174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.086051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.086331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.086607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.087890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.096090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 134/287] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/role_assignments?user.id=fb6e16500d574a8b94b76cf53c84b1b0&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=246514336b4549609174329cae41663a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:36.096313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.096403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.096506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 154/288] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:36.097608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.105885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f209e7-9ae2-4057-af95-ef7af589c78a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.110781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.111589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.111947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.112296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.112746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1535cc-405d-4dff-bfdc-80aee1813c9b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.113253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:36.113633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.115387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.118372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fbeff-6e09-44a8-9a77-12ba2a5c0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.119320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fbeff-6e09-44a8-9a77-12ba2a5c0fef admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.119810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fbeff-6e09-44a8-9a77-12ba2a5c0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.120265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fbeff-6e09-44a8-9a77-12ba2a5c0fef admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.121221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fbeff-6e09-44a8-9a77-12ba2a5c0fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.123439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fbeff-6e09-44a8-9a77-12ba2a5c0fef admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.125855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 135/289] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:36.135145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.145662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52687-e2c6-4225-91d9-4f6c0f1d3b96 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.150984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.151881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.152161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.153432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] PATH_INFO: `/v3/users/74ffb5afc28e40abadde44124b68ed7f` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.154047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] RBAC: Authorizing `identity:get_user(user_id=74ffb5afc28e40abadde44124b68ed7f)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.156282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.158388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 136/290] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/users/74ffb5afc28e40abadde44124b68ed7f => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:36.164202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.174614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799313b-fb87-4c3f-8400-16e5bb24f50d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.179423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.186993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.186993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.186993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.186993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.186993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.186993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 137/291] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:36 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:36.192346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:36.203103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e2e0c-f2e8-4dc3-a653-dff46832a66b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:36.207858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913b8fb-1f4f-4cc3-80a3-c491e4186cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:36.208868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b8fb-1f4f-4cc3-80a3-c491e4186cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:36.209147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b8fb-1f4f-4cc3-80a3-c491e4186cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:36.210001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b8fb-1f4f-4cc3-80a3-c491e4186cc1 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/74ffb5afc28e40abadde44124b68ed7f/roles/3150c0f2273e4c698c3699aee70e5eb1` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:36.213522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913b8fb-1f4f-4cc3-80a3-c491e4186cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3b9d050f2413391d4df1ea6733255, user_id=74ffb5afc28e40abadde44124b68ed7f, role_id=3150c0f2273e4c698c3699aee70e5eb1)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:36.215120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913b8fb-1f4f-4cc3-80a3-c491e4186cc1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:36.218483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 155/292] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:36 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:36.380806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 138/293] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:13:36 2022] PUT /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255/users/74ffb5afc28e40abadde44124b68ed7f/roles/3150c0f2273e4c698c3699aee70e5eb1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:13:38.411626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367b191-3ba3-44c8-8edc-c620c5f4fea3 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.413180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367b191-3ba3-44c8-8edc-c620c5f4fea3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.413674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367b191-3ba3-44c8-8edc-c620c5f4fea3 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.415818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 156/294] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:38.421212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.422098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.422577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.440941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:38.442400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:38.505131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 139/295] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:38.527596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367b191-3ba3-44c8-8edc-c620c5f4fea3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.540380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367b191-3ba3-44c8-8edc-c620c5f4fea3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.544807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.545592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.545960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.546232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.558279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:38.565211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:38.566709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 157/296] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:38.572414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.581473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55541bf-a1d8-49e9-9832-0b896e3ec26a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.586009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.586668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.586948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.587221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.587967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:38.588270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.589899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.598700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 140/297] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:38.604764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.620049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5343a6b-8502-442c-ae52-1fb30de5ccf3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.624854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d954-7ac9-435a-b63d-258299aa99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.625722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d954-7ac9-435a-b63d-258299aa99d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.625998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d954-7ac9-435a-b63d-258299aa99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.626269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d954-7ac9-435a-b63d-258299aa99d0 admin admin] PATH_INFO: `/v3/users/6464cd3104bd438d963eebd86b6f685d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.627474 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d954-7ac9-435a-b63d-258299aa99d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=6464cd3104bd438d963eebd86b6f685d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.629678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d954-7ac9-435a-b63d-258299aa99d0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.631605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 158/298] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/users/6464cd3104bd438d963eebd86b6f685d => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:38.636972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.647430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1b927-a216-41ee-b1b8-de42d88e3ffb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.652183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.653313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.653797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.654293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] PATH_INFO: `/v3/system/users/6464cd3104bd438d963eebd86b6f685d/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.655999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6464cd3104bd438d963eebd86b6f685d, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.657251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:38.657251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:38.657251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:38.658488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4c35-8ce7-4cf4-ae58-32399f742dbf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.707624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e7f1-f260-46f3-8558-509e8fab2d66 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.707812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e7f1-f260-46f3-8558-509e8fab2d66 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.708090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e7f1-f260-46f3-8558-509e8fab2d66 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.710466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 159/299] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:38.711581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652d9c-34c6-41cb-91b9-70820a742c90 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.713077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652d9c-34c6-41cb-91b9-70820a742c90 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.713077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652d9c-34c6-41cb-91b9-70820a742c90 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.713795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 160/300] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:38.718760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73a39-1557-4c5e-9e6c-edae00d48ad9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.719042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73a39-1557-4c5e-9e6c-edae00d48ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.719397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73a39-1557-4c5e-9e6c-edae00d48ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.737953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fab73a39-1557-4c5e-9e6c-edae00d48ad9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:38.739123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fab73a39-1557-4c5e-9e6c-edae00d48ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:38.746632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 161/301] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:38.747902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.748188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.748484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.765812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:38.766913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:38.773046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 141/302] 10.222.0.90 () {58 vars in 1355 bytes} [Mon Feb 21 01:13:38 2022] PUT /identity/v3/system/users/6464cd3104bd438d963eebd86b6f685d/roles/246514336b4549609174329cae41663a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:38.774402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b90d-fc19-4a5c-b254-4be6e7505c4e None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.774697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b90d-fc19-4a5c-b254-4be6e7505c4e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.774979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b90d-fc19-4a5c-b254-4be6e7505c4e None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.776034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 162/303] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:38.776741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.778154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 142/304] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:38.786251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.786601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.786883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.792202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c1f5-173c-4a2b-ab8d-dbc0ee691d79 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.799549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.800859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.801368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.801954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.803502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.805526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.807498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 163/305] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:38.807953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:38.808671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.809217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:38.817922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 143/306] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:38.824682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.827041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a38ac7-143d-4cf7-ab76-77e3d51ee8b0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.828480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90367d-cca4-4c6a-96b5-ad79f0e6e7d3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.832706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.833104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.833558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.833857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.833954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.834725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.834835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.835134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] PATH_INFO: `/v3/groups` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.835915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.837074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:38.837074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:38.837074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:38.838392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.848874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:38.856734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:38.857994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 164/307] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:38.858828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.868918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d982b6-6673-485b-9871-df5f6bc46a6c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.873391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.874206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.874759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.875038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.886817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:38.893909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:38.895153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 165/308] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:38.895937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.904403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 144/309] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Feb 21 01:13:38 2022] POST /identity/v3/groups => generated 229 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:38.905690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.906460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a6465-e24c-4ca5-b881-826a7c73e86d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.911348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.912053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.912406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.913800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.914086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:38.914402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.916233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.919482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc375-d6d7-4d10-92f9-bfc6dafe67c5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.935650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 166/310] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:38.938475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.939666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.941459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.942299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.946557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.946557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:38.946557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.949278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.956714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d2f8-c54d-4fd0-9fb4-57853d6ae02b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.964189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.965507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.965940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.966379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] PATH_INFO: `/v3/users/74ffb5afc28e40abadde44124b68ed7f` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.968026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 145/311] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:38.968184 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] RBAC: Authorizing `identity:get_user(user_id=74ffb5afc28e40abadde44124b68ed7f)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:38.971014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:38.973888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 167/312] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/users/74ffb5afc28e40abadde44124b68ed7f => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:38.975816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.979967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:38.989896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883d944-9697-42ed-8fdb-d97bb0131b54 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.990447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b2b3-d840-423c-a0d3-643eb3e01835 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:38.994554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.994858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:38.995438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.995537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:38.995701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.995795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:38.995972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] PATH_INFO: `/v3/users/2863b5605b514f7d978cda23a7d16a0d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:38.996076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:39.011191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:39.013393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:39.021491 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] RBAC: Authorizing `identity:get_user(user_id=2863b5605b514f7d978cda23a7d16a0d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:39.025408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:39.027036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 168/313] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:39.031426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 146/314] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:38 2022] GET /identity/v3/users/2863b5605b514f7d978cda23a7d16a0d => generated 293 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:39.032772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:39.033715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:39.043186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ac749-fcb5-46df-9c70-613995d1d053 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:39.045327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238852-87bd-4622-ad11-635f124e8b42 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:39.048135 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:39.049138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:39.049423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:39.049813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:39.050180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:39.051023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:39.051130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:39.051304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:39.051571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:39.052479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] RBAC: Adding query filter params (role.id=3150c0f2273e4c698c3699aee70e5eb1, user.id=2863b5605b514f7d978cda23a7d16a0d, scope.system=all) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:39.052796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:39.053271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:39.054880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194daa1c-7a86-403c-a63a-8d64c8b11fe6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:39.055347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 169/315] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:39 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:39.063900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:39.072173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 147/316] 10.222.0.90 () {56 vars in 1329 bytes} [Mon Feb 21 01:13:39 2022] GET /identity/v3/role_assignments?user.id=2863b5605b514f7d978cda23a7d16a0d&scope.system=all&role.id=3150c0f2273e4c698c3699aee70e5eb1 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:39.086177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a3dc8-66b2-46fa-9a53-2ebef4182b4a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:39.091874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:39.093020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:39.093020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:39.093317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:39.094173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] RBAC: Adding query filter params (role.id=3150c0f2273e4c698c3699aee70e5eb1, scope.project.id=1eb3b9d050f2413391d4df1ea6733255, user.id=74ffb5afc28e40abadde44124b68ed7f) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:39.094541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:39.096585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dd8b5-8615-4285-8e45-be5c75bcf1e1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:39.104041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 170/317] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:13:39 2022] GET /identity/v3/role_assignments?user.id=74ffb5afc28e40abadde44124b68ed7f&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=3150c0f2273e4c698c3699aee70e5eb1 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:41.120315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b7c4d-9033-46f3-9fc1-055a35d016f9 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.120852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b7c4d-9033-46f3-9fc1-055a35d016f9 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.120957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b7c4d-9033-46f3-9fc1-055a35d016f9 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.122847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 148/318] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:41.128081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.128483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.128674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.146161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:41.147889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:41.155424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 171/319] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:41.179089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b7c4d-9033-46f3-9fc1-055a35d016f9 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.190910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b7c4d-9033-46f3-9fc1-055a35d016f9 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.195050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.195829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.196106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.196375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.206522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:41.213993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:41.215370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 149/320] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:41.220702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.230220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b0c6-0e30-4545-9a5a-808ca9ab8079 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.234471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.235125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.235404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.235676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.236417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:41.236818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.238435 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b082387-529b-4aa7-adb0-8bb651854fd3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.246880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 172/321] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:41.252270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.262859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc482eb4-f504-482a-a232-61386432fc4b None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.263075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f77ed-759c-40c2-8225-dab775039021 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.263196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc482eb4-f504-482a-a232-61386432fc4b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.263416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc482eb4-f504-482a-a232-61386432fc4b None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.265320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 173/322] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:41.267566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.268416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.268863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.269143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] PATH_INFO: `/v3/users/6464cd3104bd438d963eebd86b6f685d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.270179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.270353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=6464cd3104bd438d963eebd86b6f685d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.270450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.270729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.273532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.275216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 150/323] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/users/6464cd3104bd438d963eebd86b6f685d => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:41.280634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.289083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:41.289741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e3a41-323c-42fc-ae1d-094880debcd6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.290254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:41.293989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.294610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.294890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.295159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.295964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] RBAC: Adding query filter params (role.id=246514336b4549609174329cae41663a, user.id=6464cd3104bd438d963eebd86b6f685d, scope.system=all) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:41.296277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.297825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 174/324] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:41.298201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.316594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 151/325] 10.222.0.90 () {56 vars in 1329 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/role_assignments?user.id=6464cd3104bd438d963eebd86b6f685d&scope.system=all&role.id=246514336b4549609174329cae41663a => generated 510 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:41.320746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.330193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3276-982d-4644-9b0b-252eb579bb00 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.335406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132549-79e9-4aaa-abbc-580811d0451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.336223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132549-79e9-4aaa-abbc-580811d0451a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.336528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132549-79e9-4aaa-abbc-580811d0451a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.336804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132549-79e9-4aaa-abbc-580811d0451a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.338017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2132549-79e9-4aaa-abbc-580811d0451a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.339758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2132549-79e9-4aaa-abbc-580811d0451a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.341472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 175/326] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:41.347151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.357261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f72d-ab24-4253-b305-b1f8279aeb42 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.361594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.362262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.362540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.362810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] PATH_INFO: `/v3/groups` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.363522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.365509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.392197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d96a-db84-419d-b5d8-e7b821030435 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.392394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d96a-db84-419d-b5d8-e7b821030435 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.392675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d96a-db84-419d-b5d8-e7b821030435 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.394620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 176/327] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:41.401057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.401336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.401606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.419977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:41.421210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:41.429162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 177/328] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:41.452687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.462542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a288868-803a-4a5d-9bc9-d852cb3671d5 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.467307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.468117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.468401 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.468753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.472493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 152/329] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Feb 21 01:13:41 2022] POST /identity/v3/groups => generated 226 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:41.480778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:41.488031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:41.489558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 178/330] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:41.495476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.507559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1d23-5938-4eca-8fe1-af5f3d73b6ca admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.512868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.513558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.513840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.514117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.514894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:41.515185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.516911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.527411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 153/331] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:41.533519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.543718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf62aa-079d-441f-aa6f-2809c795f4c2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.548307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac647-3d96-400c-886b-cef40f509ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.549464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac647-3d96-400c-886b-cef40f509ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.549742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac647-3d96-400c-886b-cef40f509ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.550015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac647-3d96-400c-886b-cef40f509ff1 admin admin] PATH_INFO: `/v3/users/2863b5605b514f7d978cda23a7d16a0d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.551391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac647-3d96-400c-886b-cef40f509ff1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2863b5605b514f7d978cda23a7d16a0d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.553867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac647-3d96-400c-886b-cef40f509ff1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.555603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 179/332] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:41 2022] GET /identity/v3/users/2863b5605b514f7d978cda23a7d16a0d => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:41.561482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:41.572819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1765ea-1aa7-4623-8fe2-ded33f6dd3fb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:41.577567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956bca3-91fa-4548-bd3d-4e936380743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:41.578444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956bca3-91fa-4548-bd3d-4e936380743e admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:41.578728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956bca3-91fa-4548-bd3d-4e936380743e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:41.579004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956bca3-91fa-4548-bd3d-4e936380743e admin admin] PATH_INFO: `/v3/system/users/2863b5605b514f7d978cda23a7d16a0d/roles/3150c0f2273e4c698c3699aee70e5eb1` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:41.580543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956bca3-91fa-4548-bd3d-4e936380743e admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2863b5605b514f7d978cda23a7d16a0d, role_id=3150c0f2273e4c698c3699aee70e5eb1)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:41.582181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956bca3-91fa-4548-bd3d-4e936380743e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:41.649158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 154/333] 10.222.0.90 () {58 vars in 1355 bytes} [Mon Feb 21 01:13:41 2022] PUT /identity/v3/system/users/2863b5605b514f7d978cda23a7d16a0d/roles/3150c0f2273e4c698c3699aee70e5eb1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:13:44.319038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb008-c171-4fd2-8211-5d1ac59d6fa4 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.319565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb008-c171-4fd2-8211-5d1ac59d6fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.319565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb008-c171-4fd2-8211-5d1ac59d6fa4 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.321823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 180/334] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:44.327896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.328367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.328509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.343937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45745-d610-49a8-9eb7-25aee8842d5c None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.344668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45745-d610-49a8-9eb7-25aee8842d5c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.345150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45745-d610-49a8-9eb7-25aee8842d5c None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.347392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 181/335] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:44.355659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:44.356910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:44.367941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 155/336] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:44.371012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.371546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.372019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.398869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:44.400410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:44.411758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 182/337] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:44.424872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.437568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.437832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59a4e8-4d16-4118-ba76-51c4f77cad82 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.442308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745524e-96fc-4511-a499-faa08da30f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.443038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745524e-96fc-4511-a499-faa08da30f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.443856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745524e-96fc-4511-a499-faa08da30f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.444154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745524e-96fc-4511-a499-faa08da30f0d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.448671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b63f-f020-4972-978b-593178f376a7 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.462232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b0da7-c151-4392-b57e-e66f376a8527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.465466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b0da7-c151-4392-b57e-e66f376a8527 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.465739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b0da7-c151-4392-b57e-e66f376a8527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.466021 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b0da7-c151-4392-b57e-e66f376a8527 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.469438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745524e-96fc-4511-a499-faa08da30f0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:44.488470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-6745524e-96fc-4511-a499-faa08da30f0d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:44.489864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 156/338] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:44.494704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e77ec2-1438-4bce-ab56-e5b1abb6b4ca None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.494844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e77ec2-1438-4bce-ab56-e5b1abb6b4ca None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.495351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e77ec2-1438-4bce-ab56-e5b1abb6b4ca None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.499858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 157/339] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:44.500463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b0da7-c151-4392-b57e-e66f376a8527 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:44.505373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e77ec2-1438-4bce-ab56-e5b1abb6b4ca None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.510774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-209b0da7-c151-4392-b57e-e66f376a8527 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 01:13:44.521377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 183/340] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:44.523296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.523585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.523865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.534736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e77ec2-1438-4bce-ab56-e5b1abb6b4ca None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.546032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.552451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.552451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.552451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.552451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:44.552451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.552451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.554071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:44.555544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:44.559786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 158/341] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.562431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.575286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 184/342] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:44.576380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.586847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94613237-7b6c-422d-a28f-451f49af8c1c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.589925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af385-9368-4604-9dd7-8d38f5df731d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.597946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.598619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.598903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.599181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.600519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:44.600822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.602400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.602520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.603368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.603861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.604329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.622550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 159/343] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.623445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.628740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.630531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.644238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 185/344] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:44.646946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df4b01-675b-4355-9f66-97b88d7d463a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.648735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.652773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.653572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.653855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.654134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.663068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568907-231d-431d-a74f-f89b5adcb755 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.673293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.676455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.676455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.676455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] PATH_INFO: `/v3/users/2863b5605b514f7d978cda23a7d16a0d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.676455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] RBAC: Authorizing `identity:get_user(user_id=2863b5605b514f7d978cda23a7d16a0d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.678366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.679980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 186/345] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/users/2863b5605b514f7d978cda23a7d16a0d => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.680788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:44.688094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:44.690097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.700006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 160/346] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:44.700896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.714320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fd0d9-3970-4afd-902f-e3bf04ca2821 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.718904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b829b-e9a8-4e55-a409-974ae829880f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.727095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.727956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.728240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.728581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.730196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.730845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.731122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.731391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.732231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] RBAC: Adding query filter params (role.id=3150c0f2273e4c698c3699aee70e5eb1, user.id=2863b5605b514f7d978cda23a7d16a0d, scope.system=all) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:44.732568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.734457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.736459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.738523 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.740483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 187/347] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.742614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.763858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 161/348] 10.222.0.90 () {56 vars in 1329 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/role_assignments?user.id=2863b5605b514f7d978cda23a7d16a0d&scope.system=all&role.id=3150c0f2273e4c698c3699aee70e5eb1 => generated 510 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.764572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae434585-8f9b-4147-8c6c-85de0dd70d2c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.766168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.775967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.776682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.776971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.777268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.778032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:44.778344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.779997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.789183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1142-f510-4f6f-9e37-99d4ae442535 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.797981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.798850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.799129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.799404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.802357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 188/349] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.807869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.816353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.817443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:44.817443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:44.817443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:44.818721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.820480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 162/350] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.827276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69569d1c-3c70-45de-a1c2-1519da6c0036 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.828865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.838175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.838840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.839127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.839406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.853672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb42d1-fc60-442b-9237-5a41a9e1df85 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.859014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.860848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.863480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.864145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.864458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.864732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.866090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:44.866398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.868248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.886763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 163/351] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 260 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.888783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 189/352] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:44.902796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.916356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82ba9-a394-4eda-9e08-f5e487832234 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.924322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.925250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.925536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.925816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.927162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.929360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.931553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 164/353] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.937929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.947201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb112e6-afc4-46f3-8763-39689815dfa6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.960090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.961411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.961915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.962422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.966430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:44.967795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:44.967795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:13:44.967795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:13:44.969490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fc2e5-19eb-49e3-b944-3d9ce6728f84 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:44.971558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 190/354] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:44.977645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:44.989923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f668a-3a34-4b3f-85ba-da33ddf89c70 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:44.997582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:44.998256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:44.998545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:44.998840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:44.999973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=246514336b4549609174329cae41663a, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:45.000313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:45.002254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ca38c-4d70-4147-9ec8-69ef99a69ba5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:45.013544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 165/355] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:44 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=246514336b4549609174329cae41663a => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:45.175668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581412-34e2-4f13-a04a-d3ff30d34d33 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.176394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581412-34e2-4f13-a04a-d3ff30d34d33 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.176940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581412-34e2-4f13-a04a-d3ff30d34d33 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.179675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 191/356] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:45.186126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.186419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.186688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.213646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:45.214910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:45.227817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 166/357] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:45.266128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581412-34e2-4f13-a04a-d3ff30d34d33 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.286446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581412-34e2-4f13-a04a-d3ff30d34d33 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.294211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.295430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.295919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.296398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.312771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:45.321166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:45.326898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 192/358] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:45.329326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.343144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f534df-2d92-437d-add1-15c3b442f1b0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.351490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.352165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.352460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.352742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.353496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:45.353801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:45.355399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:45.367047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 167/359] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:45.373006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.384518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2f0c-7096-4bc1-aadd-a4d1bc757a6b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.393572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.394274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.394556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.394888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.405889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:45.407893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:45.424180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 193/360] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:45.430819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.445987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bf60c-658f-43f5-9baf-a4cb4e3f2a01 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.456531 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.457404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.457685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.457958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.459496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:45.461662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:45.463344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 168/361] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:45.470018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.481157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d303c-4173-41d3-92ce-7775c1a27d1d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.488631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32151b3-5bd6-40ef-bd8a-c1624a705afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.489538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32151b3-5bd6-40ef-bd8a-c1624a705afc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.489821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32151b3-5bd6-40ef-bd8a-c1624a705afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.490095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32151b3-5bd6-40ef-bd8a-c1624a705afc admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.493051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32151b3-5bd6-40ef-bd8a-c1624a705afc admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:45.495016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32151b3-5bd6-40ef-bd8a-c1624a705afc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:45.497221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 194/362] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:45.503266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.517568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a639-98b0-4bdc-aac4-033e31f05017 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.523831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.524509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.524792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.525066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.525896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=246514336b4549609174329cae41663a, scope.project.id=1eb3b9d050f2413391d4df1ea6733255) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:45.526203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:45.528081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd291-c7fa-4a3d-ad0b-24afb77cbca6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:45.541308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 169/363] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=246514336b4549609174329cae41663a => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:45.829031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fde6e-7c53-4add-9332-47090785fd0e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.829378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fde6e-7c53-4add-9332-47090785fd0e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.829568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fde6e-7c53-4add-9332-47090785fd0e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.831592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 195/364] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:45.837515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.837805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.838085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.861455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:45.862669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:45.872283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 170/365] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:45.925152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fde6e-7c53-4add-9332-47090785fd0e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.942380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fde6e-7c53-4add-9332-47090785fd0e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:45.947258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:45.948059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:45.948344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:45.948647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:45.969342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:45.977269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:45.979814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 196/366] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:45.984704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:45.997612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb94740-19e8-417e-8c80-a30dd6309fd6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.004545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.005208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.005487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.005787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.006558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:46.006860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.012517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.022161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 171/367] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.027450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.042484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c72a8-a7c4-4fcb-8374-600df4bf87c4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.052057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.052797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.053592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.053872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.062332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.064175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.078378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 197/368] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:46.084090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.097702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90624-2a19-4fe3-b5e6-0a8f8172ef92 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.105457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.106382 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.106663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.106937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.109446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.111566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.113297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 172/369] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.119885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.131886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b06c53-9f54-4736-adc8-9de7b575032f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.141033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998c034-0291-4be3-ab66-e58568392454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.141961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998c034-0291-4be3-ab66-e58568392454 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.142307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998c034-0291-4be3-ab66-e58568392454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.142582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998c034-0291-4be3-ab66-e58568392454 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.144713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998c034-0291-4be3-ab66-e58568392454 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.147369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998c034-0291-4be3-ab66-e58568392454 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.149578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 198/370] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.155510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.168515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431bf26-6a8b-4f63-8efc-c7a93b8267ae admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.176542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.177199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.177481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.177804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.178637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=1eb3b9d050f2413391d4df1ea6733255) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:46.178946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.180826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43e1eb-5a24-4d11-b932-548eaef1b805 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.193125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 173/371] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.549286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb04a01-ec60-49f4-a2aa-5a655755b103 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.549286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb04a01-ec60-49f4-a2aa-5a655755b103 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.549286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb04a01-ec60-49f4-a2aa-5a655755b103 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.549286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 199/372] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:46.557384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.557922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.557922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.581688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:46.582879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:46.593664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 174/373] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:46.615827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb04a01-ec60-49f4-a2aa-5a655755b103 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.632017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb04a01-ec60-49f4-a2aa-5a655755b103 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.639029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.640086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.640606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.641093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.652632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:46.671116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:46.672998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 200/374] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:46.678928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.693947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf1cf-8eb8-46c2-91dd-6b65d713be86 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.703979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.704673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.704957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.705236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.705990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:46.706294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.707889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.722481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 175/375] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.728262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.741399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81407-41c2-4a89-809d-2d1de3e7f1e0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.748932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.750267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.750753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.751230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.761025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.763053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.774347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 201/376] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:46.780041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.794238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164cf4-d342-4969-958b-79c48c9f674a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.804655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.805462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.805738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.806007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] PATH_INFO: `/v3/projects/9596a32ec75d4659b27e6c7a766d2b35` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.813412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] RBAC: Authorizing `identity:get_project(project_id=9596a32ec75d4659b27e6c7a766d2b35)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.815256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.817474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 176/377] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/projects/9596a32ec75d4659b27e6c7a766d2b35 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.823823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.836470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37457-ee8f-4a4c-b5f7-6b8f43021590 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.843963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f7cf5-ca8d-4dab-86c8-495112199a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.845163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f7cf5-ca8d-4dab-86c8-495112199a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.845689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f7cf5-ca8d-4dab-86c8-495112199a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.846165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f7cf5-ca8d-4dab-86c8-495112199a5f admin admin] PATH_INFO: `/v3/groups/5c0bd2dbc0ca4fb28878176d44dff674` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.857275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f7cf5-ca8d-4dab-86c8-495112199a5f admin admin] RBAC: Authorizing `identity:get_group(group_id=5c0bd2dbc0ca4fb28878176d44dff674)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.859734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f7cf5-ca8d-4dab-86c8-495112199a5f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.862112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 202/378] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/groups/5c0bd2dbc0ca4fb28878176d44dff674 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:46.868820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:46.881818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ca171-f0d9-48b2-8e99-f90f16d76103 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:46.892516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:46.893171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:46.893447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:46.893717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:46.894546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] RBAC: Adding query filter params (group.id=5c0bd2dbc0ca4fb28878176d44dff674, role.id=2b566b9d44514140984818f0428be699, scope.project.id=9596a32ec75d4659b27e6c7a766d2b35) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:46.894853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:46.896774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cec5c-89b1-4f92-a0ec-3c2760a291ec admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:46.909007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 177/379] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:46 2022] GET /identity/v3/role_assignments?group.id=5c0bd2dbc0ca4fb28878176d44dff674&scope.project.id=9596a32ec75d4659b27e6c7a766d2b35&role.id=2b566b9d44514140984818f0428be699 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:47.977139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064c34f-f34f-4aa1-8456-a543f70ffef4 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:47.978106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064c34f-f34f-4aa1-8456-a543f70ffef4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:47.978584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064c34f-f34f-4aa1-8456-a543f70ffef4 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:47.980565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 203/380] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:47.985986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:47.986422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:47.986596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.013440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:48.014623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:48.022607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 178/381] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:48.054244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064c34f-f34f-4aa1-8456-a543f70ffef4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.074007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064c34f-f34f-4aa1-8456-a543f70ffef4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.081015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.082057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.082553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.083061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.097387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:48.105556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:48.106953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 204/382] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:48.112804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.127058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2254c45-d0e3-4fb7-8685-0cbec3113d03 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.136107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.136812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.137095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.137369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.138115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:48.138416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.139998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e8f0-0776-4252-bec2-5cbe8b6e9b59 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.153011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 179/383] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:48.158364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.173793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031397c9-1f8e-4848-b6c0-46a688f2b4b8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.181149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.182224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.182697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.183183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.186928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.189174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.191074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 205/384] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:48.194511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d3ee-c4f7-439b-a5da-29e027903e46 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.194796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d3ee-c4f7-439b-a5da-29e027903e46 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.195070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d3ee-c4f7-439b-a5da-29e027903e46 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.197099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 180/385] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:48.197984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.202064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.202349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.202620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.210219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30b9c-82ca-4f44-a637-5aa739ff7dd2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.221962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.224958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.225532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.226000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.230238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.232805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.235154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 206/386] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:48.242974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:48.243535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.245520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:48.262862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cab98-ce0d-46e9-b33a-e02a4fcadb7d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.265187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 181/387] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:48.276011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.277249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.277765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.278414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/groups/a97d00b7075e4315a54aa6253f690a86/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.281415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2abaf64745eb9e2eac4926e4870d, group_id=a97d00b7075e4315a54aa6253f690a86, role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.284549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.293860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.307008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807cd89-3eac-48ff-b03b-06986496e93b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.316014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.317077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.317556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.317999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.333322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:48.341089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:48.342467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 182/388] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:48.349020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.360106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb209f-d7f2-43d9-9e83-304e935da361 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.364566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 207/389] 10.222.0.90 () {58 vars in 1463 bytes} [Mon Feb 21 01:13:48 2022] PUT /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/groups/a97d00b7075e4315a54aa6253f690a86/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:48.442330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.443405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.443888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.444342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.445286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:48.445760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.447542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.460685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 183/390] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:48.466415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.480164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed33788-8c0b-4104-b8c7-d1f9470d3d5c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.491521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.492508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.492961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.493309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.494747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.496936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.502950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 208/391] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:48.508230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.526477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01b2fd-3de8-4304-b742-a02d823fd701 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.536889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593617a-c3f1-407b-8e76-c840212b6f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.538292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593617a-c3f1-407b-8e76-c840212b6f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.538786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593617a-c3f1-407b-8e76-c840212b6f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.539249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593617a-c3f1-407b-8e76-c840212b6f65 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.545376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593617a-c3f1-407b-8e76-c840212b6f65 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.547772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593617a-c3f1-407b-8e76-c840212b6f65 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.550063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 184/392] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:48 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:48.556045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:48.573844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918a71-4a1a-40ee-9f38-4eb0f3ae5087 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:48.578690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dabeb-dfc5-4cbd-8c42-584d0ca12a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:48.579788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dabeb-dfc5-4cbd-8c42-584d0ca12a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:48.580081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dabeb-dfc5-4cbd-8c42-584d0ca12a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:48.580363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dabeb-dfc5-4cbd-8c42-584d0ca12a04 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/groups/a97d00b7075e4315a54aa6253f690a86/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:48.582509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dabeb-dfc5-4cbd-8c42-584d0ca12a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2abaf64745eb9e2eac4926e4870d, group_id=a97d00b7075e4315a54aa6253f690a86, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:48.586077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dabeb-dfc5-4cbd-8c42-584d0ca12a04 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:48.664968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 209/393] 10.222.0.90 () {58 vars in 1463 bytes} [Mon Feb 21 01:13:48 2022] PUT /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d/groups/a97d00b7075e4315a54aa6253f690a86/roles/246514336b4549609174329cae41663a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:49.053827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd67e2-b1fb-48df-bfd6-0d19b8e51533 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.054331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd67e2-b1fb-48df-bfd6-0d19b8e51533 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.054405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd67e2-b1fb-48df-bfd6-0d19b8e51533 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.056482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 185/394] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:49.061302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.061717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.061881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.085365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:49.086568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:49.167871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 210/395] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:49.189663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd67e2-b1fb-48df-bfd6-0d19b8e51533 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.214844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd67e2-b1fb-48df-bfd6-0d19b8e51533 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.219197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.219992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.220274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.220579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.237094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:49.244175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:49.252317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 186/396] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:49.257627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.270769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65a84a-86b0-4132-8d89-e35a98346bef None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.285108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.285805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.286087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.286359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.287669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:49.287975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.289621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.302939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 211/397] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:49.308056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.318739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50497-0f86-4cb9-9780-8bc154ee0845 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.327102 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.328035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.328302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.328650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.329832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.331945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.333639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 187/398] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:49.339666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.354579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cff441-fcd9-4cac-8a4d-4441f91f9c39 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.364881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03807f9-defa-4bed-b058-0896c0d386fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.365791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03807f9-defa-4bed-b058-0896c0d386fc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.366069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03807f9-defa-4bed-b058-0896c0d386fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.366350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03807f9-defa-4bed-b058-0896c0d386fc admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.373450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03807f9-defa-4bed-b058-0896c0d386fc admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.375826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03807f9-defa-4bed-b058-0896c0d386fc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.377877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 212/399] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:49.384085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.394884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf6617-6966-4889-8644-62b73ec1b21c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.404527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.405472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.405754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.406033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255/groups/a97d00b7075e4315a54aa6253f690a86/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.408112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3b9d050f2413391d4df1ea6733255, group_id=a97d00b7075e4315a54aa6253f690a86, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.410866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.531850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add36e-0150-49a9-9aac-5dcd6eb2774c None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.532164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add36e-0150-49a9-9aac-5dcd6eb2774c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.532396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add36e-0150-49a9-9aac-5dcd6eb2774c None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.534486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 213/400] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:49.545790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 188/401] 10.222.0.90 () {58 vars in 1463 bytes} [Mon Feb 21 01:13:49 2022] PUT /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255/groups/a97d00b7075e4315a54aa6253f690a86/roles/246514336b4549609174329cae41663a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:49.547994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.548286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.548703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.569182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:49.570321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:49.656650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 214/402] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:49.691924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.703295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38372df-53b1-4baa-8240-a582511706c0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.713089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.713922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.714204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.714482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.727367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:49.739435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:49.741547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 189/403] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:49.747533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.757736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276ee9-3048-4a9d-ae58-3aec0c113b85 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.768451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.769148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.769430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.769704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.770539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:49.770844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.772605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ea9ff-846f-4020-a6b4-bb046e511cfe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.782621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 215/404] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:49.788794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.799259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c595e77-02ab-45fc-bfcf-00864b1b17b5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.801597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625275d-e3bf-4e63-82bc-a65c7edd8c62 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.801892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625275d-e3bf-4e63-82bc-a65c7edd8c62 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.802166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625275d-e3bf-4e63-82bc-a65c7edd8c62 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.804807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 216/405] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:49 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:49.810590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.810878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.811154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.812704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.813661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.814099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.814379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.815883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.827505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.829226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 190/406] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:49.834720 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.839995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:49.841291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:49.847905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52ffd-6435-46d9-880d-ae877b188f1e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.855271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 217/407] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:49.861134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.862008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.862290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.862565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.863789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.866458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.868870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 191/408] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:49.874347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.880006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.887609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebde0f-92d8-4605-943c-2750159ab58c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.892526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69982-6c74-4db2-8585-3c3791e9b26b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.892985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.894310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.894786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.895272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255/groups/a97d00b7075e4315a54aa6253f690a86/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.899798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3b9d050f2413391d4df1ea6733255, group_id=a97d00b7075e4315a54aa6253f690a86, role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.902924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.908005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.911551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.911551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.911551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.924816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:49.932245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:49.934049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 192/409] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:49.939304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.951545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ff041-c76e-45ff-a2a0-2bf43ba24087 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.956480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:49.958698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:49.958698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:49.958698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:49.958698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:49.959633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:49.961377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:49.973856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 193/410] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:49.980178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:49.992981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feea74-4c4b-43d2-96ce-f5ea6d5c7821 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:49.997108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 218/411] 10.222.0.90 () {58 vars in 1463 bytes} [Mon Feb 21 01:13:49 2022] PUT /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255/groups/a97d00b7075e4315a54aa6253f690a86/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:50.057545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:50.058503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:50.058893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:50.059176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] PATH_INFO: `/v3/groups/5c0bd2dbc0ca4fb28878176d44dff674` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:50.060485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] RBAC: Authorizing `identity:get_group(group_id=5c0bd2dbc0ca4fb28878176d44dff674)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:50.062455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:50.068642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 194/412] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:49 2022] GET /identity/v3/groups/5c0bd2dbc0ca4fb28878176d44dff674 => generated 229 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:50.070432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:50.080991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269e81b-0776-47a7-8794-5b1896dea0e8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:50.085994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336826c0-0f46-47f2-a3ca-048bbff5cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:50.086902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336826c0-0f46-47f2-a3ca-048bbff5cf5d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:50.087182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336826c0-0f46-47f2-a3ca-048bbff5cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:50.087454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336826c0-0f46-47f2-a3ca-048bbff5cf5d admin admin] PATH_INFO: `/v3/projects/9596a32ec75d4659b27e6c7a766d2b35` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:50.088705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336826c0-0f46-47f2-a3ca-048bbff5cf5d admin admin] RBAC: Authorizing `identity:get_project(project_id=9596a32ec75d4659b27e6c7a766d2b35)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:50.090527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336826c0-0f46-47f2-a3ca-048bbff5cf5d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:50.092232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 219/413] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:50 2022] GET /identity/v3/projects/9596a32ec75d4659b27e6c7a766d2b35 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:50.098217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:50.109646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1820d04-23b9-449a-aa96-e3cdf87c0412 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:50.114378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0394f-dbb3-484f-9a36-0f81ce84971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:50.115325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0394f-dbb3-484f-9a36-0f81ce84971a admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:50.115610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0394f-dbb3-484f-9a36-0f81ce84971a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:50.115896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0394f-dbb3-484f-9a36-0f81ce84971a admin admin] PATH_INFO: `/v3/projects/9596a32ec75d4659b27e6c7a766d2b35/groups/5c0bd2dbc0ca4fb28878176d44dff674/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:50.118084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0394f-dbb3-484f-9a36-0f81ce84971a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9596a32ec75d4659b27e6c7a766d2b35, group_id=5c0bd2dbc0ca4fb28878176d44dff674, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:50.120919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0394f-dbb3-484f-9a36-0f81ce84971a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:50.196668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 195/414] 10.222.0.90 () {58 vars in 1463 bytes} [Mon Feb 21 01:13:50 2022] PUT /identity/v3/projects/9596a32ec75d4659b27e6c7a766d2b35/groups/5c0bd2dbc0ca4fb28878176d44dff674/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:13:51.403179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043060c-bfbb-4a90-9945-b1075171fa9d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.403694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043060c-bfbb-4a90-9945-b1075171fa9d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.403770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043060c-bfbb-4a90-9945-b1075171fa9d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.405803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 220/415] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:51.411510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.411978 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.412160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.437498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:51.438692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:51.519380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 196/416] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:51.562216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043060c-bfbb-4a90-9945-b1075171fa9d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:51.578469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043060c-bfbb-4a90-9945-b1075171fa9d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:51.587092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:51.587092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.587092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.587092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.603895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:51.611948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:51.613634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 221/417] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:51.621950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:51.631581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de51f38-6309-4d76-bef9-334f818f93c7 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:51.645304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:51.646003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.646844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.647122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.647894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:51.648198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:51.649844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:51.658905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 197/418] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:51.665050 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:51.680632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089830d5-a070-4f38-9df4-3c55d39b3deb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:51.688419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:51.689079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.689358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.689627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.701985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:51.703797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:51.718229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 222/419] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:51.723524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:51.734116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb93fa-b5c2-4086-8842-e3db65fc66f3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:51.746119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:51.747011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.747297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.747576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.753314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:51.756405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:51.758859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 198/420] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:51 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:51.764520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:51.776691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469620-87a1-4979-ab78-f3994f01f21a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:51.784712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96274510-069a-465e-b0aa-4116ecf81444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:51.785864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96274510-069a-465e-b0aa-4116ecf81444 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.786429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96274510-069a-465e-b0aa-4116ecf81444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.786957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96274510-069a-465e-b0aa-4116ecf81444 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.789041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96274510-069a-465e-b0aa-4116ecf81444 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:51.791200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96274510-069a-465e-b0aa-4116ecf81444 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:51.793368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 223/421] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:51 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:51.799202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:51.813423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430af8-28d7-4679-9ff3-7101b011bf3f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:51.821019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:51.821672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:51.821954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:51.822228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:51.823058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:51.823369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:51.825248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8826570-15c3-413e-92f5-05e2dac8a22a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:51.837916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 199/422] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:51 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:52.149241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5e6e-69e9-463f-b985-1807b1d476f7 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.149744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5e6e-69e9-463f-b985-1807b1d476f7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.150133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5e6e-69e9-463f-b985-1807b1d476f7 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.152189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 224/423] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:52.157566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77ef9-81a2-4f10-ab91-46d47d546518 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.157847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77ef9-81a2-4f10-ab91-46d47d546518 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.158117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77ef9-81a2-4f10-ab91-46d47d546518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.177272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a6f77ef9-81a2-4f10-ab91-46d47d546518 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:52.179056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a6f77ef9-81a2-4f10-ab91-46d47d546518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:52.191058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 200/424] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:52.197871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cd345-ef5f-44f4-bcea-5d522355abdf None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.198195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cd345-ef5f-44f4-bcea-5d522355abdf None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.198482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cd345-ef5f-44f4-bcea-5d522355abdf None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.200301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 225/425] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:52.205758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.206251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.206749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.216866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cd345-ef5f-44f4-bcea-5d522355abdf None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.230405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:52.231998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:52.234985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cd345-ef5f-44f4-bcea-5d522355abdf None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.242348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.243940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.243940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.243940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.248283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 201/426] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:52.261548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:52.268436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:52.269949 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 226/427] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:52.273982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.275505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.288855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d855-e68b-4dd2-a1cf-887a0f10ae2c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.291065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304138-e985-465b-a693-46d8a78d1f22 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.296529 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.297340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.297667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.297940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.299357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.300023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.300312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.300620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.301382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:52.301694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.303850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.310532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:52.318852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 227/428] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:52.319197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 01:13:52.324783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 202/429] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:52.326241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.327457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.337730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009e99-daec-40d6-a2d0-556a770a66e8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.342714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.343691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.343969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.344242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.345059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:52.345165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aabbc-53d9-4a19-b426-3abea5577991 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.345413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.347190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.350330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.350971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.351256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.351534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.357403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 203/430] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:52.362825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.363491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.366049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.373843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc2dd-bf69-4731-afc6-940e94273a17 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.376955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 228/431] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:52.382277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.386876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.387840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.388372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.388860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.391566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b947-8153-41ac-8bf0-d691f5c9fa47 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.397030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.397880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.398244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.398489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] PATH_INFO: `/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.399480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.399794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed8b2abaf64745eb9e2eac4926e4870d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.401678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.402096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.404034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 229/432] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/projects/ed8b2abaf64745eb9e2eac4926e4870d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:52.409369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.412517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 204/433] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:13:52.418268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.420703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d66e68-ee0a-4c49-9dd7-ed7df6144680 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.425421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.426272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.426607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.426887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.429265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0905e-2a82-4ac9-a748-0143b2c30a56 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.430633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.434504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.435033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.436298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.436879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.437379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.440486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 230/434] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:52.443881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.446096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.447370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.449592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 205/435] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:52.455203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.458967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f010723-b187-4b5c-9af7-316b7858ff3c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.464047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.464788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.465113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.465355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.466246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=246514336b4549609174329cae41663a, scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:52.466561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.467939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962ed4-73df-4db3-9148-da7ac518ad85 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.468652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.473213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84fd9-4e1a-4b9e-80e4-adbdfeb255f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.474496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84fd9-4e1a-4b9e-80e4-adbdfeb255f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.474969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84fd9-4e1a-4b9e-80e4-adbdfeb255f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.475517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84fd9-4e1a-4b9e-80e4-adbdfeb255f1 admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.477143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84fd9-4e1a-4b9e-80e4-adbdfeb255f1 admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.479512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84fd9-4e1a-4b9e-80e4-adbdfeb255f1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.480575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 231/436] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=ed8b2abaf64745eb9e2eac4926e4870d&role.id=246514336b4549609174329cae41663a => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:52.482334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 206/437] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:52.488901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.503224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63093ab5-c72d-4583-ad6e-af4af5a8f9e7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.509221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.510290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.510770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.511306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.512409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=246514336b4549609174329cae41663a, scope.project.id=1eb3b9d050f2413391d4df1ea6733255) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:52.512982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.515332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ed375-c6b5-4865-8646-70bfde84de88 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:52.522723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 232/438] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=246514336b4549609174329cae41663a => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:52.867510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47985c1-81cf-4fca-8788-97ad72d0e7cc None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.867804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47985c1-81cf-4fca-8788-97ad72d0e7cc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.868082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47985c1-81cf-4fca-8788-97ad72d0e7cc None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.869898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 207/439] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:52.875424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.875719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.876001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.893868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:52.895650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:52.903769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 233/440] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:52.927543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47985c1-81cf-4fca-8788-97ad72d0e7cc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.940922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47985c1-81cf-4fca-8788-97ad72d0e7cc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.945214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.945996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.946273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.946600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.958228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:52.966135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:52.967341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 208/441] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:52.973087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:52.982939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d29eb-32bc-4c11-bf35-97b12655cbb3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:52.987383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:52.988042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:52.988323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:52.988676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:52.989424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:52.989723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:52.991413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.000560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 234/442] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:53.005866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.016121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65b924-769e-4137-8dfd-8376ab70c7b6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.020733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.021894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.022178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.022448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.032060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.033860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.043634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 209/443] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:53.049334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.059089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e992c7b-d9e4-454d-a9d7-e2549b2c8ce4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.065657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.066509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.066790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.067071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] PATH_INFO: `/v3/projects/1eb3b9d050f2413391d4df1ea6733255` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.068312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] RBAC: Authorizing `identity:get_project(project_id=1eb3b9d050f2413391d4df1ea6733255)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.070419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.072159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 235/444] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/projects/1eb3b9d050f2413391d4df1ea6733255 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:53.077734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.087286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e020-4e52-41e2-b8f8-18ef12fc50eb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.092190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354b1a2-dfa1-4816-bd1a-00a504a0642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.093084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354b1a2-dfa1-4816-bd1a-00a504a0642d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.093353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354b1a2-dfa1-4816-bd1a-00a504a0642d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.093614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354b1a2-dfa1-4816-bd1a-00a504a0642d admin admin] PATH_INFO: `/v3/groups/a97d00b7075e4315a54aa6253f690a86` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.094784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354b1a2-dfa1-4816-bd1a-00a504a0642d admin admin] RBAC: Authorizing `identity:get_group(group_id=a97d00b7075e4315a54aa6253f690a86)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.096735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354b1a2-dfa1-4816-bd1a-00a504a0642d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.100261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 210/445] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/groups/a97d00b7075e4315a54aa6253f690a86 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:53.106289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.116288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210ab2e-904b-4672-bce6-0c435cb66db2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.121542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.122138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.122422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.122704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.123730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] RBAC: Adding query filter params (group.id=a97d00b7075e4315a54aa6253f690a86, role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=1eb3b9d050f2413391d4df1ea6733255) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:53.124056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.126283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cce937-7d30-41fe-abb5-e9bc7356b190 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.133085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 236/446] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/role_assignments?group.id=a97d00b7075e4315a54aa6253f690a86&scope.project.id=1eb3b9d050f2413391d4df1ea6733255&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:53.502500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac33f1-7792-4023-9f01-90df3d5f9673 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.502976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac33f1-7792-4023-9f01-90df3d5f9673 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.502976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac33f1-7792-4023-9f01-90df3d5f9673 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.504756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 211/447] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:53.510640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.511060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.511194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.529310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:53.530483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:53.537985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 237/448] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:53.561679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac33f1-7792-4023-9f01-90df3d5f9673 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.573880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac33f1-7792-4023-9f01-90df3d5f9673 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.577974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.578737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.579012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.579276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.589814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:53.596648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:13:53.597767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 212/449] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:53.603274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.612037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c841-66f9-4c27-a2c6-9d9e6e77cada None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.617030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.617643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.618062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.618479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.619646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:53.620112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.622899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.632876 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 238/450] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:53.638376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.648251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a1c9a-7110-4ea2-8df3-a372ff6fda21 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.652487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.653112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.653392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.653662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.661547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.663853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.672543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 213/451] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:53.677911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.687328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58ff30-cae8-4578-8c89-00b865fffd41 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.691624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.692481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.692772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.693051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] PATH_INFO: `/v3/projects/9596a32ec75d4659b27e6c7a766d2b35` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.694226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] RBAC: Authorizing `identity:get_project(project_id=9596a32ec75d4659b27e6c7a766d2b35)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.696180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.697831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 239/452] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/projects/9596a32ec75d4659b27e6c7a766d2b35 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:53.702662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.711418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e2e2-21f0-4db7-ad19-9d1f27205b77 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.715606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38141cdd-3a75-4ec2-9db6-a02bc6428d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.716411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38141cdd-3a75-4ec2-9db6-a02bc6428d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.716713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38141cdd-3a75-4ec2-9db6-a02bc6428d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.716982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38141cdd-3a75-4ec2-9db6-a02bc6428d1e admin admin] PATH_INFO: `/v3/groups/5c0bd2dbc0ca4fb28878176d44dff674` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.718119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38141cdd-3a75-4ec2-9db6-a02bc6428d1e admin admin] RBAC: Authorizing `identity:get_group(group_id=5c0bd2dbc0ca4fb28878176d44dff674)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.719969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38141cdd-3a75-4ec2-9db6-a02bc6428d1e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.721493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 214/453] 10.222.0.90 () {56 vars in 1201 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/groups/5c0bd2dbc0ca4fb28878176d44dff674 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:53.727262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:53.736321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f9389-3c8f-4f88-b7bd-0c79fa55be3a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:53.740618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:53.741216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:53.741500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:53.741778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:53.742580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] RBAC: Adding query filter params (group.id=5c0bd2dbc0ca4fb28878176d44dff674, role.id=2b566b9d44514140984818f0428be699, scope.project.id=9596a32ec75d4659b27e6c7a766d2b35) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:53.742892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:53.744704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c11f3-8267-47cd-bd4b-00572f77b463 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:53.750695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 240/454] 10.222.0.90 () {56 vars in 1397 bytes} [Mon Feb 21 01:13:53 2022] GET /identity/v3/role_assignments?group.id=5c0bd2dbc0ca4fb28878176d44dff674&scope.project.id=9596a32ec75d4659b27e6c7a766d2b35&role.id=2b566b9d44514140984818f0428be699 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:56.583599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138a8a-f82c-4164-894d-2598c62c206c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.584686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138a8a-f82c-4164-894d-2598c62c206c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.584686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138a8a-f82c-4164-894d-2598c62c206c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.586773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 215/455] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:56.591718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.592601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.593124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.619479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:56.620692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:56.638039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 241/456] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:56.674668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138a8a-f82c-4164-894d-2598c62c206c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:56.697073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138a8a-f82c-4164-894d-2598c62c206c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:56.701992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:56.703028 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.703545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.704026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.720153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:56.722024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:56.741799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:13:56.743001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 216/457] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:56.748759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:56.761293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecaa6f-a9fc-4fe3-94da-aab55044ed52 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:56.769032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:56.769687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.769967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.770245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.770961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:56.771802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:56.773419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc3086-497c-470e-b143-b011f5d01349 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:56.784896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 242/458] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:56.790781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:56.805802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdd87d-f17e-4020-b854-217223116406 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:56.814127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:56.814805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.815084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.815356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.816079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:56.818091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:56.857650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c25e-bcb5-4d0a-b148-a91eb977623d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.858345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c25e-bcb5-4d0a-b148-a91eb977623d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.858888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c25e-bcb5-4d0a-b148-a91eb977623d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.861275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 243/459] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:56.866753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.867290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.867786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.886276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:56.887814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:56.896630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 244/460] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:56.921952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:56.931589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b70591-a3a9-4c2f-b152-5c136f304b08 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:56.932610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 217/461] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:56 2022] POST /identity/v3/users => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:56.940513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:56.941640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:56.942125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:56.942600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:56.955784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:56.958096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:56.977984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:13:56.979997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 245/462] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:56.986193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:56.996821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d253f54-6544-42c3-8822-4bf194256269 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.002027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.002933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.003397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.003924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.004878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:57.005909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.007101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:57.007101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:13:57.007101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:13:57.008337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25993fe3-2af6-4bf3-b523-85130d077574 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.027441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 218/463] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:57.033422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.044224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa66a0f-a471-4efc-b803-b01f5bdb9a93 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.049365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.050409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.050887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.051356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.052407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.054680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.090774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329dd4b-72cd-4b53-8f20-474018666ddd None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.091386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329dd4b-72cd-4b53-8f20-474018666ddd None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.091849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329dd4b-72cd-4b53-8f20-474018666ddd None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.094356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 219/464] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:57.100882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fdd21-ac7d-4edd-b5af-23df1521096a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.101522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fdd21-ac7d-4edd-b5af-23df1521096a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.102054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fdd21-ac7d-4edd-b5af-23df1521096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.121865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-008fdd21-ac7d-4edd-b5af-23df1521096a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:57.123392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-008fdd21-ac7d-4edd-b5af-23df1521096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:57.134988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 246/465] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/users => generated 248 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:57.141701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 220/466] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:13:57.169695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.181347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730cba3-c5a1-40b1-a6f5-2c20df7a6ccd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.186613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.192027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.192027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.192027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.202558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.204828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.210435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036415c-c74e-43dc-8baa-9b8e436e9a16 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.211033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036415c-c74e-43dc-8baa-9b8e436e9a16 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.211498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036415c-c74e-43dc-8baa-9b8e436e9a16 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.214498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 221/467] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:13:57.222543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.223136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.223658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.230782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:13:57.232347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 247/468] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:57.238447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.247032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:57.249381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:57.251767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830bb4f-dfa7-4869-8812-98614d0d1337 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.258470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.263682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.263682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.263682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.263682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:57.263682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.263682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.267472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 222/469] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:57.280379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 248/470] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:13:57.285906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.297618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.298873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232286a5-58ce-4ea5-bb01-3c7f49efbb8e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.310239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013939e0-ee7d-4900-901b-f0e891a4a3f8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.310461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03b1d9-21d7-4794-93d6-e39db55f9a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.311050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03b1d9-21d7-4794-93d6-e39db55f9a25 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.311332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03b1d9-21d7-4794-93d6-e39db55f9a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.311635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03b1d9-21d7-4794-93d6-e39db55f9a25 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.312492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03b1d9-21d7-4794-93d6-e39db55f9a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.314464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03b1d9-21d7-4794-93d6-e39db55f9a25 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.316562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.317561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.318022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.318464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.330435 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.332811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.353053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:13:57.355006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 249/471] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:57.363357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.375497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560efad-e324-485f-bfd1-b9abb28a860e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.380400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.381376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.381860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.382310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.383316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:57.383800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.385722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.399183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 250/472] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:57.404684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.415956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43846b3e-69fb-4965-8421-3fd092271bce admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.420817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77fe5-74cf-43b8-8bc6-375e354da472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.421753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77fe5-74cf-43b8-8bc6-375e354da472 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.422240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77fe5-74cf-43b8-8bc6-375e354da472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.422708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77fe5-74cf-43b8-8bc6-375e354da472 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.423618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77fe5-74cf-43b8-8bc6-375e354da472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.425894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77fe5-74cf-43b8-8bc6-375e354da472 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:57.437630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 223/473] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/users => generated 248 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:13:57.556490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 251/474] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/users => generated 249 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:13:57.907326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da32a-8a27-4875-bef2-f809b5ead82c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.907852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da32a-8a27-4875-bef2-f809b5ead82c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.907932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da32a-8a27-4875-bef2-f809b5ead82c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.909690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 224/475] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:57.915630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.916068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.916258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.935319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:57.936533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:57.948558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 252/476] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:57.970221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da32a-8a27-4875-bef2-f809b5ead82c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:57.986891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da32a-8a27-4875-bef2-f809b5ead82c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:57.991280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:57.991942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:57.992221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:57.992524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:57.993281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:57.994893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:58.063537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.sql.core [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 21 01:13:58.063537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 21 01:13:58.063537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [parameters: {'id': '6a51639c92514078b9f6ec673695c2b1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 21 01:13:58.063537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 01:13:58.085407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 21 01:13:58.086794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 225/477] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:13:57 2022] POST /identity/v3/roles => generated 144 bytes in 117 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:58.092654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:58.102194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592930-f35a-44e3-b8e4-c2bf51b28133 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:58.112740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725511df-b173-4802-9866-9b0b47981c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:58.113565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725511df-b173-4802-9866-9b0b47981c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:58.113843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725511df-b173-4802-9866-9b0b47981c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:58.114120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725511df-b173-4802-9866-9b0b47981c35 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:58.128286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725511df-b173-4802-9866-9b0b47981c35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:58.136233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-725511df-b173-4802-9866-9b0b47981c35 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 01:13:58.137477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 253/478] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:13:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:13:58.143296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:58.157455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5fd8-d593-4cbe-878d-dc7391a84db2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:58.165031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:58.165700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:58.165982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:58.166256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:58.167059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:13:58.167365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:13:58.169047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6062e-b430-43d1-8a02-109cd2352ef3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:13:58.177970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 226/479] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:13:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:13:59.835066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a3f6-635d-4298-a9e4-43deda4a2d5f None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:59.835597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a3f6-635d-4298-a9e4-43deda4a2d5f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:59.835597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a3f6-635d-4298-a9e4-43deda4a2d5f None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:59.837662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 254/480] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:59.842434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:59.842720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:59.842996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:59.845071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50925c94-41cd-44c0-af58-062273ab40ec None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:59.845481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50925c94-41cd-44c0-af58-062273ab40ec None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:59.845656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50925c94-41cd-44c0-af58-062273ab40ec None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:59.850046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 227/481] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:13:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:13:59.867108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:59.868273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:59.868383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:59.868885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:59.869467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:59.886520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 255/482] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:59.900589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:13:59.902088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:13:59.910898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:59.921400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9f0c-7782-480b-9511-8401e411c32c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:59.923466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 228/483] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:13:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:13:59.937308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:59.938204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:59.938488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:59.938771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:59.946228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:59.954091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:13:59.960569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd719-35d7-4f3e-98d7-d9115cd9f97d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:59.962693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:13:59.964483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 256/484] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:13:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:13:59.970979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:13:59.971777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:13:59.972061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:13:59.972336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:13:59.976140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:13:59.987139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bf391-f3ef-42b1-86b5-7f784bcdde6e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:13:59.991687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:00.000000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:00.001393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 229/485] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:13:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:00.004184 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.004888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.005171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.005979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.006735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.007043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.008689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.010920 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.025330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 257/486] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:13:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:00.027396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2b864-af3c-4c4e-a72a-7cde62a67b8e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.033469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.039509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.040521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.041001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.041469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.042421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.042941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.044864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.052234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ecdc-a9ef-4749-b86d-d8a6e23f3a13 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.055657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 230/487] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.061377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.067033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.068384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.068691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.068969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.084191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635e9b-f138-4e1e-895e-0df62549fb94 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.094181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.094529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.095598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.096113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.096396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.096805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.114738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.116926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.119630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:00.127920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 258/488] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.131057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.145369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:00.151394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52746066-ff76-47db-8c8b-95b325fd8f4b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.153030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 231/489] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:00.159340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.167242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.168194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.168690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.169171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.170107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.170598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.172395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.179432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50ea71-d912-4828-9107-5a99c9ac75bf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.191406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 259/490] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.193298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.194191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.194682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.195144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.196149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.196687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.197718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.199539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.217596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909601ab-64f2-4a77-b740-81c5a3b3a799 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.224583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 232/491] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.227019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.236755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.237588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.237873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.238151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.238250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e861f-f14e-46ea-8e43-4fdc75fef269 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.243181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.244002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.244330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.244713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.254094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.256880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.260723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.262786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.279221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:14:00.280600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 233/492] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.287808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:00.289802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.294804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 260/493] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.295609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.307646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357129de-f3c1-42a3-8294-0a75e13ff91c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.311024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab038-6a7e-4f46-b43b-4b78d8460739 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.312347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.313068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.313347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.313620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.314545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.314850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.315909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:00.315909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:00.315909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:00.317151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.325060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.325731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.326016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.326291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.327133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.327437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.328457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:00.328457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:00.328457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:00.329595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f28e-569c-492c-bb47-e4b2fe9d4a81 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.355364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 261/494] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.361451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.372851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4cec6-b9ea-48d7-bcad-f89b3aef0da7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.379399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d5cfc-60d6-4313-9ae9-5bd6cea6f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.380045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5cfc-60d6-4313-9ae9-5bd6cea6f294 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.380453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5cfc-60d6-4313-9ae9-5bd6cea6f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.381245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5cfc-60d6-4313-9ae9-5bd6cea6f294 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.390630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 234/495] 10.222.0.90 () {56 vars in 1158 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.390793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d5cfc-60d6-4313-9ae9-5bd6cea6f294 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.391962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f0d22-70d0-41b2-b013-ecd76028e516 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.392251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f0d22-70d0-41b2-b013-ecd76028e516 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.392557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f0d22-70d0-41b2-b013-ecd76028e516 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.394359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 235/496] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:00.398483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d5cfc-60d6-4313-9ae9-5bd6cea6f294 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.399100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f0d22-70d0-41b2-b013-ecd76028e516 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.408656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 262/497] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:00.409912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.410199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.410479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.416116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f0d22-70d0-41b2-b013-ecd76028e516 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.420874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.421525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.421810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.422139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.429644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:00.430934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:00.431100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.432766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.439316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 263/498] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:00.442032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 236/499] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:14:00.444338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.447792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.456386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14a5b-a933-4c4e-931b-3148e15e6d2b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.462311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c051a9-c67d-44a1-a33a-0f820e880dc5 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.467081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.467917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.468257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.468612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.469089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.469888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.470172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.470448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.480020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.482220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.482919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.484879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.506957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:00.509102 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 237/500] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:00.509276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:00.509716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.511172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 264/501] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.521055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.524547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491a35-ee79-42cf-a7fd-d854b75aa333 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.529136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.529928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.530210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.530484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.533009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644091a-15ff-4169-90cc-2da52714a931 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.538870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.539577 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.539860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.540137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.541077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:00.541260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.541492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.543267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.549312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:00.551480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 238/502] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.553293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.556337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 265/503] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.558475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.568737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7ada-04ed-434a-8d72-bac74a1e99ea admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.570393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd431a7-7515-4665-949d-ed6d5590b13b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.573278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.574014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.574364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.574709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.575506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.575658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.575959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.576303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.576616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.576897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.577702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.577883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.578020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.580023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.590215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 239/504] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.591141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.591577 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 266/505] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:00.596659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.603348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1e4fa-db1a-4525-b2b3-2c3019ecac9e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.608248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.608461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20fc7-d08c-4d41-81a7-641d1a353511 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.609194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.609562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.609906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.613718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.615104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.615394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.615723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.617787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.619873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.624477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.627043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.635963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:00.637469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 240/506] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.638343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.643439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:00.644921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 267/507] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.645698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.657295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20041856-8429-484c-a211-c82f9ca6d99f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.658728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbccc8-0f42-4d58-a597-0b4afea3b01d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.662087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.662998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.663385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.663761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.663934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.664825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.665108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.665434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.666603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.666963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.668392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:00.668392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:00.668392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:00.669578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.675040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.676928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.688346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 268/508] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.689339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.699063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac515e-d9b8-408e-9e92-c46f68a50a4f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.699381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-115550da-fd67-41a6-b424-8793ad656ed9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:00.700608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 241/509] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.701836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c967-bf7c-4abd-8458-dc2c3c77f8ba None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.702119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c967-bf7c-4abd-8458-dc2c3c77f8ba None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.702396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c967-bf7c-4abd-8458-dc2c3c77f8ba None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.704207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 242/510] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:00.704873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c967-bf7c-4abd-8458-dc2c3c77f8ba None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.706669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.707590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.708105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.708659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.709649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.709957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.711831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.719734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c967-bf7c-4abd-8458-dc2c3c77f8ba None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.728326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.728612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 269/511] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.728788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.728788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.729081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.729224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.729224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=89e39e92f70b45e39ae07a123beff178) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.729224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.729224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210663c-9820-4b34-960b-2f82629cff67 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.734093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 243/512] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/role_assignments?user.id=89e39e92f70b45e39ae07a123beff178&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.734955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.735243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.735518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.750165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ee0c-3674-4fb5-8e7b-a7082bb30fde admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.755318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:00.756599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.757116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:00.757775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.758368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.758841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.759954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.760608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.762740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.772452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 244/513] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:00.772452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.789676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8319f67-6587-4486-b3d4-e657426a0059 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.791194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 270/514] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.792310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.803697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.804370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.804675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.804960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.805824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=8a526052e42248f3a38b329084dd262c) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.806133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.808002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.811678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0092248-4008-4f73-b749-4dbedf61605d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.814274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 245/515] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/role_assignments?user.id=8a526052e42248f3a38b329084dd262c&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.817746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.819099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.819620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.820143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.820620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.833973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:00.843116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:00.845908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 271/516] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.847048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e40c8-9385-4d87-ae3c-d480f0142600 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.855364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.857242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.858038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.858321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.858580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.872640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.873078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.876485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a1d3f-a48e-4995-a72f-f5a61b37ff5f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.888225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.888952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.889278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.889552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.891731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.892067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.895871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.909073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 01:14:00.912175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 246/517] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:00.914501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 272/518] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:00.919987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.921413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:00.940918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9c95-daef-477d-9b51-b7aaaffee91b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.941874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c83abf-0310-4d6f-b9f2-5279df00dd28 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:00.949209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.950564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.950857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.951131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.951814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:00.952502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:00.953385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:00.953654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:00.955446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:00.955757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.958537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.977736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:00.980037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:00.992488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 247/519] 10.222.0.90 () {56 vars in 1158 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:00.997899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.014863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:01.016110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 273/520] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:01.018193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e77-4187-4d37-9977-915971819d62 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.022936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.023648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.023925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.024243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.033327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.035132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.038499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.049529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba065-f770-42b2-915a-2174997bbeb1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.061264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.061987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.062362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.062636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.063356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.064523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 248/521] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:01.064703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.066378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.070389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.079107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9715-a3d2-49e6-953a-08b423e2fd99 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.085850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.085850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.085850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.085850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.086543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 274/522] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:01.092128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.098217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.100086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.105744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359c50-73e5-4126-8a42-73e5a12e9f66 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.111965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.113161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.113655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.114128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.119347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:01.120992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 249/523] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:01.127008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.127008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.127981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.146569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b2699-a341-4737-a5f3-4044d804b70b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.148525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 01:14:01.150283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 275/524] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:01.156470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.170331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65339441-3342-4aac-af82-fb03cdf809e5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.175475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.176579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.184745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.184745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.184745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.184745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.184745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.185217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.185782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.186060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.186333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.187055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.187358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.188975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.207683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 276/525] 10.222.0.90 () {56 vars in 1160 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:01.209322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.222338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5edf0-e7ba-47e2-a28e-d4acb9b6f54c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.222917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 250/526] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:01.225426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.234279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.235229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.237716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.238248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.245924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3bf5d-1e0f-4aad-b344-79872e47ea50 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.252687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.252930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.253946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.254426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.254727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.255201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.263600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.265922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.276453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 277/527] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:01.284477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:01.287037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 251/528] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:01.288189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.297314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e07c-0d89-49f4-8524-bbef31b61a11 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.297642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.308449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240d7e-59cb-4d5f-9ca5-a9f516f57c62 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.310457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.311244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.311590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.311870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.314785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.315766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.316246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.316875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.318507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.319047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.320364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:01.320364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:01.320364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:01.321937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.335639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.337902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.341387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 252/529] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:01.353503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.357731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-24a82d04-d4be-4c22-bb31-d5518b196308 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:01.359207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 278/530] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:01.365962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286523e-54c3-44f1-b8ad-86d8f38308ed None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.365962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286523e-54c3-44f1-b8ad-86d8f38308ed None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.365962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286523e-54c3-44f1-b8ad-86d8f38308ed None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.366914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 279/531] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:01.367684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286523e-54c3-44f1-b8ad-86d8f38308ed None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.369421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81eeb3e-d7ca-4675-ad11-51961ef6a0e1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.374557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.375684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.376169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.376681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.377769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=5f7d6c94406d4ae0aac5f772ff240ecf) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.378290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.381019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dea8bf-8627-4893-b611-8f45bd2c5a00 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.381197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286523e-54c3-44f1-b8ad-86d8f38308ed None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.386742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.387473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.387751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.388099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.388578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 253/532] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/role_assignments?user.id=5f7d6c94406d4ae0aac5f772ff240ecf&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:01.388797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.389147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.390426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.390912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.391097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.391574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.410245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 280/533] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:01.412566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.414242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:01.415755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:01.423034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fba410-f400-4176-b191-f38b2af0a2ac admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.424834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 254/534] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:01.442626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.444004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.444281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.444575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.450420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.458556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.458556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.467097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea954-7e42-4e0b-bbdd-41cfda618520 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.473918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:01.475326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 281/535] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:01.477056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.478133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.478684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.479139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.481116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.495206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442a989-56ec-414a-8317-c0eca1818b75 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.498462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.499207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.499561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.500170 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.501065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.501336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.501443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.503211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.503383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.517684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 282/536] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:01.524781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.535639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30320568-afcc-444e-abaf-4b5249c8d884 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.540788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.541482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.541768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.542039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.542858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=1a673d8aa3054723887a56a4f4f76c90) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.543162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.545061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.548858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:01.550165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 255/537] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:01.551322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 283/538] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/role_assignments?user.id=1a673d8aa3054723887a56a4f4f76c90&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:01.556416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.579155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3bfe-5164-4de7-ae9f-6e4f5d05b481 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.594814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.595499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.595778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.596051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.596817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:01.597120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.598750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640087-26b0-4cdf-81e5-3661dcb07d9a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.631091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 256/539] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:01.637026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:01.650534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf5401-8124-4a14-8eb8-65535cd9b50f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:01.664241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83fca-45d9-4d9d-8c66-cfa9fd2df585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:01.664949 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83fca-45d9-4d9d-8c66-cfa9fd2df585 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:01.665231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83fca-45d9-4d9d-8c66-cfa9fd2df585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:01.665503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83fca-45d9-4d9d-8c66-cfa9fd2df585 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:01.666222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c83fca-45d9-4d9d-8c66-cfa9fd2df585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:01.668203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c83fca-45d9-4d9d-8c66-cfa9fd2df585 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:01.764037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 284/540] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:14:01 2022] POST /identity/v3/users => generated 247 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:03.446234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0f2c-3863-4173-8ec6-b1fca3dee6ae None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.446955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0f2c-3863-4173-8ec6-b1fca3dee6ae None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.446955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0f2c-3863-4173-8ec6-b1fca3dee6ae None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.448785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 257/541] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:03.461059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.461605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.461605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.485422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:03.486613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:03.495242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 285/542] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:03.530361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0f2c-3863-4173-8ec6-b1fca3dee6ae None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.548768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0f2c-3863-4173-8ec6-b1fca3dee6ae None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.554009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb523737-af39-456d-982e-fcd0106872bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.554801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb523737-af39-456d-982e-fcd0106872bb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.555082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb523737-af39-456d-982e-fcd0106872bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.555329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb523737-af39-456d-982e-fcd0106872bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.577068 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb523737-af39-456d-982e-fcd0106872bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:03.585829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-cb523737-af39-456d-982e-fcd0106872bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:03.587358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 258/543] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:03.592843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.605958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d151fa-51b3-4d19-b10a-2a139fe02a0d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.619568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.620239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.620562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.620834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.621580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:03.621879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.623626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.633163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b863ea-cf31-4519-b79e-6d0273d2489e None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.633446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b863ea-cf31-4519-b79e-6d0273d2489e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.633728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b863ea-cf31-4519-b79e-6d0273d2489e None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.634099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 286/544] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:03.635538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 259/545] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:03.639672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.649500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61508-09ae-47c8-8ced-31413e378f7a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.656624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.656907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.657181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.659071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.659851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.660128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.660398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.685072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.686958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.688269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:03.689472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:03.712890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:03.713237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 260/546] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:14:03.714369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 287/547] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:03.727068 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.743266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.746036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e850f-f918-4853-b673-e2ca91f8015c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.753668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.754518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d111d7-1e56-4d36-9dd8-368654ffdfb9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.754876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.755935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.756406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.757542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:03.758125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.759585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.760266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.760371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.760668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.760944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.775396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:03.779476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:03.781088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 261/548] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:03.784692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 288/549] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:03.789706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.791308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.801451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245f511-386e-44a8-ba84-ed1cae02817b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.806724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.806887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf82a-4b8c-43a2-b036-edbedf6bcba4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.807399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.807687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.807968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.808773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:03.809086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.810777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.825042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 289/550] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:03.826538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.829219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.830036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.830315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.830586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.836856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103e421-1acf-436c-9890-3b98d6ec76b2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.841421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.842210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.842494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.842770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.850714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.852773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.856129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.858127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.876416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:03.877293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:14:03.878016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 290/551] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:03.879046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 262/552] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:03.886412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.901800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd1b5-4dbb-4988-acbd-158a1ba91b1d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.907745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.912021 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.912732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.913013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.913290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.914139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:03.914448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.924453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.934869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226867-5ff8-4176-a372-428c49219103 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.941679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 291/553] 10.222.0.90 () {56 vars in 1158 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:03.943996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:03.955509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541988d-cdd4-4567-aea2-e3436f66ebb9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:03.957154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.957820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.958122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.958429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.959148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:03.959447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.960649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:03.961133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.961601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:03.961953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:03.962303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:03.973580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:03.976028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:03.991538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 263/554] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:03.994376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:04.000316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 292/555] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:04.001453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.005914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.018135 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355343f-4b38-43a2-929d-5315ad251901 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.019789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9881-3fce-4dd3-8345-eea34a6bccea admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.023883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.025004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.025660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.026161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.027230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.027794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.029946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.041270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.042030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.042297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.042567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.046174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 293/556] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.052723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.063376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56e089-9701-4dd8-ab93-b84b667dc897 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.065563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.067714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.068996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.070081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.070673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.071171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.079134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.081517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.096012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:04.096388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:04.097527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 264/557] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.104860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 294/558] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:04.108738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.108873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.119847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a759baf-1de7-4077-a838-1cf8e99b2de8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.125076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.126012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.126506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.127031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.128025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.128685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.130726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c893bb-caab-4fa2-ac77-267453430e88 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.131111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b686cf-e9ab-45ff-817d-c08447bb54f7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.143364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.144816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.147237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.147723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.149038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.150458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.153037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 295/559] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.154314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400a16-313d-467c-ac6f-5eb979d0fe4d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.156130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b777de-3f96-4bf2-8140-7d2b1a052396 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.156419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b777de-3f96-4bf2-8140-7d2b1a052396 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.156724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b777de-3f96-4bf2-8140-7d2b1a052396 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.159751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 296/560] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:04.164513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b777de-3f96-4bf2-8140-7d2b1a052396 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.175862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 265/561] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.180940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.180940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.180940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.182572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b777de-3f96-4bf2-8140-7d2b1a052396 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.188005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.189175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.189785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.190321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/89e39e92f70b45e39ae07a123beff178/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.198606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:04.199781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:04.207811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=89e39e92f70b45e39ae07a123beff178, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.208080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 266/562] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:04.209425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.214071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.232571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8073c22-dc2d-4a55-a7cd-5992c7c95822 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.239425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.241088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.241417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.241836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.258742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.261762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.284763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:04.287367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 267/563] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.291903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.299251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b20179-df21-4926-a594-7765535a1889 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.303234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.304108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.304394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.304775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.315649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:04.326286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 297/564] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:04 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/89e39e92f70b45e39ae07a123beff178/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:14:04.327189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.328945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:04.336120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 268/565] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.338886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.354090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f1fc1-ea3c-4b2d-acc0-93e27ad04ea7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.434614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b006366-f387-4b69-8eb2-e4af0b6a335c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.439454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.440143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.440451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.440735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.441482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.441794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.443491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7e30-5a80-4d8a-be15-f07fb3aa142a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.451831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.453235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.453520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.453795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.454587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.454862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.456511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7928a-7549-4b7d-91c4-ce39e75d7dc4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.460688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 298/566] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.462468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d276-1378-40be-aead-5adfa878b4be None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.463459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d276-1378-40be-aead-5adfa878b4be None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.463942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d276-1378-40be-aead-5adfa878b4be None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.466348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 299/568] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:04.471124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 269/568] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:04.471738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d276-1378-40be-aead-5adfa878b4be None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.473636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.473986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.474770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.494030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d276-1378-40be-aead-5adfa878b4be None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.502820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:04.504868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:04.506017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.506912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.507271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.507622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.515455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.516966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 270/569] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:04.518090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.525446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.529334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe338-c9c8-4b08-b349-de3858bee0d9 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.535560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.536973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.537403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.537879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.541355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:04.542646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 300/570] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.545958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.552963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.556158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.562544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e1d7-47a3-46d1-9c70-0149fe7fc463 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.567265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.568758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.569039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.569308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.580455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:04.581738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:04.583324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 271/571] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.584722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.588220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:04.590616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 301/572] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.594996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.597590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560bd19-5f41-4d72-b7e0-8d02b379540a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.603520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.604481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.604909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.605332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.605481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc60d72-c46e-4d27-a4ef-321b3f4aa117 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.606500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.607062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.609190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.610489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.611197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.611979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.612322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.613144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.613521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.615217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.623931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 272/573] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.625328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.636779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 302/574] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.637671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.639357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226bc50-9964-4fdf-8224-d3fc2275fd6d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.645108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.646803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.647238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.647658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.648478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49e287-dc38-482b-89e9-849a51c11427 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.648753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.649203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.651117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.653515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.654508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.654895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.655238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/8a526052e42248f3a38b329084dd262c/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.663777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 273/575] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.664823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.681244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=8a526052e42248f3a38b329084dd262c, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.681472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebefca1-8115-443a-b5c3-80bc47071ce4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.684469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.686973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.688658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.689199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.689615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.703200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.706821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.729254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 01:14:04.731571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 274/576] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.732525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.748274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c78c-814f-4f62-9625-9c8e1f61bbdd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.756071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.756892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.758534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.758534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.758794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 303/577] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:04 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/8a526052e42248f3a38b329084dd262c/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:04.760125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.777966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.781362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.816843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:04.823264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 275/578] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.841413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.852055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030866-dc41-42f7-80c9-94631748cfc6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.897059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642bc0a-72d8-42c2-8288-882d5b290b6c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.901897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.902581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.902863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.903141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.904054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.904368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.912365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.930222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 304/579] 10.222.0.90 () {56 vars in 1158 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:04.936800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:04.948918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cd4d4-dfd0-4333-9aee-8faa09f43128 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:04.955432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.956896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.957212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.957491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.970046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.972654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.983113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:04.984129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:04.984643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:04.985141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:04.986059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:04.986562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:04.988375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:04.992887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:04.993747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 305/580] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:04.999096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.008609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 276/581] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:05.010288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add4ec7-07ef-44b3-883b-d02dba3c5534 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.014517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.016992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.017705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.017992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.018271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.019000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.019310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.020996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.028858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095dd0-bb6a-4642-8834-e82f654f0fa4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.037069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 306/582] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:05.038901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.040045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.040580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.041053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.042608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.050688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.053716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.054670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409c770-f1fc-49bd-b9ff-2e9dc5fc590d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.060188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.061024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.061305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.061581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.069889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.071150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 01:14:05.071890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.072871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 277/583] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:05.079357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.088356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:05.089905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 307/584] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:05.090246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6be6a8-3b0d-43f2-9ab2-dc4f9ed17b66 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.095417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.096962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.097953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.098432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.098983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.100019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.100641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.102813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.105426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21cf8-195c-4197-a81f-b517e35ffeee admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.110818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.112670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.112670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.112670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.112896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.113209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.115973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.127040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 278/585] 10.222.0.90 () {56 vars in 1160 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:05.132480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 308/586] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:05.133714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.136892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.147543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e90ac-766c-4171-abce-c6f864c64c1b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.147880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3f73-4833-4750-896e-0a1b8d337a4c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.157408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.158296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.158576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.158846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/5f7d6c94406d4ae0aac5f772ff240ecf/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.160983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.161809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.162086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.162357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.183541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.185468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.197227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=5f7d6c94406d4ae0aac5f772ff240ecf, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.200009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.215673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:05.221560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 279/587] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:05.222659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.233814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d0c92-f721-4d43-bcff-bc0885d5ca21 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.238499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.239205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.240067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.240354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.241122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.241423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.243023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.259235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 280/588] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:05.262494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.273993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1ef9-c9e3-448f-a1ae-c0813e50a64e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.281874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 309/589] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:05 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/5f7d6c94406d4ae0aac5f772ff240ecf/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:14:05.290294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.291212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.291491 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.291844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.299834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.301898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.321092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-b15b440b-b9d4-4ef5-b0b5-9761fdb08142 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:05.322741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 281/590] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:05.328542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.376665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c0ecd-56e3-4162-99ee-ae3c2aa8e3ed None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.376665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c0ecd-56e3-4162-99ee-ae3c2aa8e3ed None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.376665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c0ecd-56e3-4162-99ee-ae3c2aa8e3ed None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.378889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 282/591] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:05.386129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.386416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.386676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.413856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:05.415086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:05.418562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70229bc1-13c8-4dab-bc82-363a134081df admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.428557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.429235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.429518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.429794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.430596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.430902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.432833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.437745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 283/592] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:05.447792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 310/593] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:05.453530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.463419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfa3c-a5df-45bb-804e-0f8f99c321c9 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.468168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.469098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.469377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.469648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/1a673d8aa3054723887a56a4f4f76c90/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.487679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.493673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=1a673d8aa3054723887a56a4f4f76c90, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.496548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.504741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22200a02-89e6-4fd3-ace9-d3c4c447d746 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.511213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.512054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.512394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.512700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.525337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:05.532699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:05.534377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 311/594] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:05.541131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.552842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd84e-efde-4218-9e2f-3ea1c26678bc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.558289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.559354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.559832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.562361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.562361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.562361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.563845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.573860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 312/595] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:05.579862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.591057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6811ec3-d3e2-4024-a10c-4a6e97cf07f6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.595667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.597613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.597613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.597613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.608448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.610454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.630711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:05.631164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 284/596] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:05 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/1a673d8aa3054723887a56a4f4f76c90/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:05.636649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 313/597] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:05.638441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.719724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff834-603e-4f9c-84eb-85253e57f95f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.725952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.726629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.726914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.727191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.727923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.728231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.729903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.744901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 285/598] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:05.753770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.773403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963664f2-db55-41e3-9249-1b466146625e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.778127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.779111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.779533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.779948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.797904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.800349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.824252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:14:05.825705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 314/599] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:05.831585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.843768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7d18c-81b6-4624-8cf4-296c5be1a394 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.855535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.856400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.856787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.857137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.858155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:05.858533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.860621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.889209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 286/600] 10.222.0.90 () {56 vars in 1156 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:05.894749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.906783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b0ae-66ac-465a-9187-077139b3ab50 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.914551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.915495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.915969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.916458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.928150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.930261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:05.941857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 315/601] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:05.947951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:05.962137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3163aad-748f-4f25-af4a-49c0e0f0b6ba admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:05.968266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:05.969385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:05.969989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:05.970452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:05.983423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:05.985574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:06.011352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:06.012928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 287/602] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:06.018473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:06.029194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5e81-5ec7-4b0e-a17c-7feeb90bd873 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:06.034075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:06.034938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:06.035432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:06.035897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:06.036883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:06.037381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:06.044454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:06.058562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 316/603] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:06.064132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:06.075625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151afe-219b-49b7-897c-c5dde0fb4c11 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:06.084024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:06.085096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:06.085589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:06.086050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:06.095490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:06.097745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:06.116114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:06.117583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 288/604] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:06.123210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:06.135181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655249a2-a95e-4eff-b3b4-f21fcbf40fbe admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:06.139964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:06.140982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:06.141540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:06.142030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:06.143027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:06.143627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:06.146513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c8088-af2e-480e-aa3d-33b608d3fd5c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:06.167238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 317/605] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:06.173019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:06.186441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf602e1-9bed-41be-aaa5-493cdd4f8f08 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:06.191054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:06.191989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:06.193146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:06.193631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:06.194645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=f126d69c4bcf42aaa7d5b85e40e93582) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:06.195145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:06.201338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778be17-5171-431b-b37e-dab108678b76 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:06.207650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 289/606] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:06 2022] GET /identity/v3/role_assignments?user.id=f126d69c4bcf42aaa7d5b85e40e93582&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.097728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65c72-095d-406d-99b6-d1360f7b6391 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.098235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65c72-095d-406d-99b6-d1360f7b6391 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.098235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65c72-095d-406d-99b6-d1360f7b6391 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.100239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 318/607] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:07.105642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.106026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.106206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.133417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:07.134618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:07.146693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 290/608] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:07.182879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a65c72-095d-406d-99b6-d1360f7b6391 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.195867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a65c72-095d-406d-99b6-d1360f7b6391 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.204726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.205527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.205812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.206087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.229782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:07.236993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:07.238555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 319/609] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:07.244247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.253782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83382ef-750b-476c-a061-88afc31bca72 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.264560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.265238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.265525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.265800 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.266607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.266924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.268540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.279555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 291/610] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.285019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.301505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b88f9-af8c-41e5-9544-cc1470d57505 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.310037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.310840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.311119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.311392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.328841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.330794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.363255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:07.364845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 320/611] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:07.370123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.389340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c802b-b654-4131-9d7f-98e4904c654f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.402423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.403092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.403378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.403662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.404393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.404725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.406325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.426872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 292/612] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.432196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.442724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1702a63-7aa6-4695-98f2-91cef4027d5c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.454345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.455235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.455516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.455841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.468548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.470690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.489988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:14:07.496780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 321/613] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:07.502822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.521884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72edad0-4677-4de1-9b45-567df598804d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.538439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.539121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.539406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.539684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.540561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.540873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.542725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.574964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 293/614] 10.222.0.90 () {56 vars in 1158 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.580455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.591779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64e2d-d2e3-4f26-a395-001a607ae592 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.605009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735efb24-d1c0-44be-8fc8-fceef4af421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.605722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efb24-d1c0-44be-8fc8-fceef4af421e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.606007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efb24-d1c0-44be-8fc8-fceef4af421e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.606285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efb24-d1c0-44be-8fc8-fceef4af421e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.617749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735efb24-d1c0-44be-8fc8-fceef4af421e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.619565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735efb24-d1c0-44be-8fc8-fceef4af421e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.635529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 322/615] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:07.641076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.657550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad742f-b6b1-4f01-ba29-0d3994c7ef8e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.675672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.676510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.676797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.677652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.696359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.698249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.722627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:07.724734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 294/616] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:07.729075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6563-e9d3-4fea-9600-86c2ae8910b3 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.729075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6563-e9d3-4fea-9600-86c2ae8910b3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.729075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6563-e9d3-4fea-9600-86c2ae8910b3 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.729815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 323/617] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:07.730672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.741454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.741609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.741901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.748299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0390e-28f8-4e71-b816-0f7139ad323d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.761591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.762266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.762550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.762827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.763587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.763901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.766737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.776772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:07.779026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:07.788324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 295/618] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.794716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.795314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 324/619] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:07.805387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcbc4-cc61-4555-89e7-60617de1fe67 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.810175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.811014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.811297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.811627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.819066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.821209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.835952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:07.837494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.844950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 296/620] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:07.846966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ed00-6bb2-4f21-9253-aba628227638 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.849802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.858632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.859437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.859716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.859991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.864148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1c7c-7e4d-424f-bb51-88b515d1e5db admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.872876 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:07.876259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.877212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.877650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.878073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.879027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.879487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.880765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:07.881849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.882112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 325/621] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:07.888217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.900393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef96a3-80ef-4e5f-a615-4b35b970e0ca admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.906278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.906830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 297/622] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.911978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.911978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.911978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.911978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.911978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.911978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.913351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.920789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 326/623] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.927035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.929309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a418252-b275-41f8-a528-24fa537592fb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.939783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.940862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2265-01f3-4f3d-a828-88c0a4f436b1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.941294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.942250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.942676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.943952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=89e39e92f70b45e39ae07a123beff178) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:07.944267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.948546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.951712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.952594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.952923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.953198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.963636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 298/624] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/role_assignments?user.id=89e39e92f70b45e39ae07a123beff178&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:07.969500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.971494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.990892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:07.992462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 327/625] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:07.998051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.008985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b5720-715f-46aa-9a8b-58257b12d0f0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.013765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.014480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.014765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.015040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.015872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.016222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.017928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.031966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 299/626] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.038117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.048615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434039e-2159-4c72-9254-d6b71f1c9a88 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.053477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.054321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.054604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.054932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.062872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.065018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.081237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:08.082881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 328/627] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:08.089386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.100624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96e15-e0fb-4857-a2b8-02d24b639091 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.105575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.106306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.106898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.106898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.107784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.108100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.110069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.130947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 300/628] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.136344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.147414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8952a-6d99-4df0-bfde-bc91c2068e8a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.152365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.153063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.153347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.153676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.166955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.168851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.182714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 329/629] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:08.188459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.199036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dbf29-8817-4e4c-88a4-4df79fe69fb6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.210188 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.210997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.211275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.211544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.228032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.229922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.252909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:08.254442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 301/630] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:08.260205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.272366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c6ff5-2735-4009-b6a0-1dccec87becb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.277707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.278364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.278690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.278923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.279646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.279951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.282869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeefce-bf3d-4b7b-8269-a3436820ffe0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.296823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 330/631] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.302267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.312047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd882-e3a9-4c8c-a510-0a871f729123 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.316751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.318108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.318396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.318670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.326892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.328995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.343136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ec10-96c3-4452-9abf-48b3e247b398 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.343435 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ec10-96c3-4452-9abf-48b3e247b398 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.343677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ec10-96c3-4452-9abf-48b3e247b398 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.343887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:08.345484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 302/632] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:08.345888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 331/633] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:08.352101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.352663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.353023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.353229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.363204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524d806-b7bd-419b-ac78-8848368d5a37 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.367891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.368620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.368904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.369180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.370021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.370425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.371238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:08.372417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:08.372611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.382843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 332/634] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:14:08.386653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 303/635] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.392370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.401970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72231ed-b82b-42c0-979b-405ae07fd654 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.406467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.407120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.407403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.407676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.408543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=8a526052e42248f3a38b329084dd262c) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.408849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.410879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.418063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.421037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153067-d39f-4cd9-8c5f-5f9c9d5937e9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.425788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 333/636] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/role_assignments?user.id=8a526052e42248f3a38b329084dd262c&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.435318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.435318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.435717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.436356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.449093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:08.456489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:08.458834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 304/637] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:08.464331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.478271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14348e-3276-4105-8e02-ff4e8f366f4f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.483344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.484267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.484728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.485146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.486064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.486511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.488249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.497827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 334/638] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.503683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.514965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb79d-a0a3-45ea-a29c-7c12fd0ad9c8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.519933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.521081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.521508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.521961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.533299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.535355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.553737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:08.555493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 305/639] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:08.561272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.575053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be225-ceb0-40e7-b6a1-5d494458d097 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.582872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.584155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.584881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.585535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.586737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.587203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.590219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.615974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 335/640] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.622790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.633217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fb143-b08b-4237-9f92-a1aaa12b0bd8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.637883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497667-698a-4b97-a632-49243088842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.638727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497667-698a-4b97-a632-49243088842e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.639010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497667-698a-4b97-a632-49243088842e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.639287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497667-698a-4b97-a632-49243088842e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.648292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20497667-698a-4b97-a632-49243088842e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.650420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20497667-698a-4b97-a632-49243088842e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.666553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-20497667-698a-4b97-a632-49243088842e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 01:14:08.668103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 306/641] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:08.678535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.687372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244baf4-1028-4685-a5f0-7d192d0a6e62 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.692002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.692744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.693076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.693351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.695215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.695578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.697544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03573a3-8604-48e2-a7f6-86e52739d0a1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.717484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 336/642] 10.222.0.90 () {56 vars in 1158 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.723112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497667-698a-4b97-a632-49243088842e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.733333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497667-698a-4b97-a632-49243088842e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.741206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d3d7-40f5-43e2-af04-5ce4498da593 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.741464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.741624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d3d7-40f5-43e2-af04-5ce4498da593 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.741624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d3d7-40f5-43e2-af04-5ce4498da593 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.741896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.741896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.741896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.742261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 337/643] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:08.748295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.748916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.749385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.750487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.753164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.764489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 307/644] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:08.771599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.782977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ceedf-d18e-4ca0-883d-310571c6215f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.784011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:08.785313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:08.788117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.789371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.789652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.789922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.793792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 338/645] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:14:08.802784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.804829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.819747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.822910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:08.824090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 308/646] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:08.829321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.833690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7abc3c-c5fd-41b4-9948-ad611afee7b6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.839984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b7d9f-71ab-48b3-9259-383ba87e710e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.840102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.840840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.841126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.841496 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.846638 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.847581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.848044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.848584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.849510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.850075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.852002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.853158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:08.861727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:08.863509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 339/647] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:08.865497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 309/648] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:08.871454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.871619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.883681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa53f94-bf01-43fd-8101-f26af3f66dad admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.884482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c96898-b061-439e-bc25-1853f777b890 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.888799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.889744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.889977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.890475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.890693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.891048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.891159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.891494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.892333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.892775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.895040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.899476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.901668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.905877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 340/649] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:08.911390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.919354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:08.920989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 310/650] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:08.921286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb32a81-1c6f-46ac-adc1-4916240c27c5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.928208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.929186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.930236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.930748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.931219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.938091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1e8b-7d8b-4d19-a509-d106849209b7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.944587 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.945285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.945929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.946215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.946493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.947277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.947587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.948087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.949467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.963670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 311/651] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:08.972478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:08.972478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 341/652] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:08.976712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.980306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.987397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a354a0-c04e-49a4-9cff-e0b4364e0f52 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.993391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa36d6-30e3-4beb-999b-09e77d86d47e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.994975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.995810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.996278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.997050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.998700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.998967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=5f7d6c94406d4ae0aac5f772ff240ecf) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:08.999458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.000023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.000621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.001139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.001912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.002191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.002300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.003862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.010900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 312/653] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/role_assignments?user.id=5f7d6c94406d4ae0aac5f772ff240ecf&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.022496 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 342/654] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.027600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.038853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cc9b-cd97-48a8-abcc-2d4009e2934c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.045827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.046760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.047048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.047324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.057537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.059674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.074967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 01:14:09.076735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 313/655] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:09.082557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.093417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9168f93-4545-4e38-809e-7e3b21d45c7c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.099544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.100233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.100608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.100887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.101849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.102167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.104204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0e6e4-1750-4335-aca1-3069682967bd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.125602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 343/656] 10.222.0.90 () {56 vars in 1160 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.131399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.142385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be968add-876b-42d2-98df-73f2df4c2e61 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.147153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81f07-4228-4d9d-8e66-8f143ec639bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.147872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81f07-4228-4d9d-8e66-8f143ec639bf admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.148157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81f07-4228-4d9d-8e66-8f143ec639bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.148521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81f07-4228-4d9d-8e66-8f143ec639bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.157811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81f07-4228-4d9d-8e66-8f143ec639bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.159725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81f07-4228-4d9d-8e66-8f143ec639bf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.172207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bb0f7-7f25-4819-adbb-9f060b0275e1 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.172750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bb0f7-7f25-4819-adbb-9f060b0275e1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.172827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bb0f7-7f25-4819-adbb-9f060b0275e1 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.174742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 344/657] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:09.174936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 314/658] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:09.183826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bb0f7-7f25-4819-adbb-9f060b0275e1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.184002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.184002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.184002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.199069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bb0f7-7f25-4819-adbb-9f060b0275e1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.205964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.206519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:09.207026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.207369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.207711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.216599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:09.217130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 315/659] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:09.221028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.223016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.243017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:09.250818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 345/660] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:09.250955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.251037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.255341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7f5e-bb31-465c-9892-f85100c0f2b8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.259994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.260884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.261168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.261442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.262050 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e484-7d1f-4824-907a-1276a903f0be admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.267848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.268540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.268823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.269119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.269826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.270131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.271764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.274891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:09.284956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:09.285302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 346/661] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:09.286943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 316/662] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:09.293941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.294289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.305107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b1be9-8cdd-44f2-b0f9-564e2945bfdd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.305412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838acd3-d51e-407d-a6a5-a9c366458f96 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.310215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.310380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.311173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.311472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.311619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.312036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.312208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.312666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.313167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.313597 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.315569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.321204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.323392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.328854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 317/663] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.334826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.341671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:09.343352 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 347/664] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:09.348476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008969-7254-449d-a4d9-cedf609bba87 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.348866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.354030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.354925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.355205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.355479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.362009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001a5b5-1629-48ac-858c-6c530532ff24 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.367355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.368195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.368529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.369017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.369499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.370218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.370718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.371229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.373307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.386069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 348/665] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:09.390878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:09.392326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.392551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 318/666] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:09.397920 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.405313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91f623-5604-4afd-ab05-dbaaa240cc60 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.409413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47629d9a-b89c-4120-8932-7fed34078f29 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.410026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.410864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.411307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.411819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.413420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=1a673d8aa3054723887a56a4f4f76c90) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.413810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.415769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.416019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.416939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.417428 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.417893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.419025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.420099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.422344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.422800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 349/667] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/role_assignments?user.id=1a673d8aa3054723887a56a4f4f76c90&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:09.437506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 319/668] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.444033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.455007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921b55-afdf-48f9-ba3e-af30e53ff686 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.460499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.461768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.462243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.462740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.472773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.475244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.490978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:14:09.492667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 350/669] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:09.498710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.510821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f2f4-e400-4e3e-bcdf-a090bfe62953 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.515914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.516971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.517511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.517961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.519003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.519547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.521702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.542164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 320/670] 10.222.0.90 () {56 vars in 1156 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.547980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.559543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aebc6-0b02-4cde-86ad-4b784da16edd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.564835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.566004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.566525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.566984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.582893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.585194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.603485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:09.605089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 351/671] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:09.610931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.622090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a1d73-c44c-4e8a-b532-4fecebafd7a6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.627104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.628039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.628529 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.629018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.629911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.630973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.632886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.645230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 321/672] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.650902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.661132 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0c2c-6799-4806-af48-266e95aee781 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.666078 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.667136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.667596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.668056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.679161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.681488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.697444 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:09.698837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 352/673] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:09.704588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.714648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1a6d-8456-4028-acd4-74e31290f1a9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.719509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.720472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.720932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.721414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.722466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:09.722946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.725292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113942fd-bb5e-4e4a-bf76-61dc1462165c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.738532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 322/674] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:09.744895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:09.756614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2670f-54ca-4148-bae1-cf47889755da admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:09.761783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76a4ab-d50a-4032-bf48-90ecdd1821f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:09.762910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a4ab-d50a-4032-bf48-90ecdd1821f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:09.763395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a4ab-d50a-4032-bf48-90ecdd1821f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:09.763840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a4ab-d50a-4032-bf48-90ecdd1821f3 admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/f126d69c4bcf42aaa7d5b85e40e93582/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:09.779556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76a4ab-d50a-4032-bf48-90ecdd1821f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=f126d69c4bcf42aaa7d5b85e40e93582, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:09.782533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76a4ab-d50a-4032-bf48-90ecdd1821f3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:09.875882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 353/675] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:09 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/f126d69c4bcf42aaa7d5b85e40e93582/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:10.857688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c37de-16f8-4228-975d-42873b787d42 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:10.858191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c37de-16f8-4228-975d-42873b787d42 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:10.858266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c37de-16f8-4228-975d-42873b787d42 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:10.860239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 323/676] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:10.865769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:10.866595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:10.867128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:10.897599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:10.899173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:10.973868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 354/677] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:11.008694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c37de-16f8-4228-975d-42873b787d42 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.026499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c37de-16f8-4228-975d-42873b787d42 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.031154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.032204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.032727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.033202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.034123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:11.035374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:11.035374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:11.035374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:11.036680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:11.056321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 01:14:11.058107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 324/678] 10.222.0.90 () {56 vars in 1150 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:11.063489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.072979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1af303-3275-450e-ab4b-33c0d52f4387 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.081923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.082832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.083864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.084401 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.085344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:11.085850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:11.087069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:11.087069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:11.087069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:11.088304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf902a0-9c8c-4e73-bc7c-6c1d9f468ff7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:11.093498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 355/679] 10.222.0.90 () {56 vars in 1145 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:11.099092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.109048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dccab-c290-4908-b3dd-67885b5fa611 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.117037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.118038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.118567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.119041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.119952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:11.120501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:11.121722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:11.121722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:11.121722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:11.122950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ac65d-d322-4610-b447-bfec84b81f23 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:11.131302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 325/680] 10.222.0.90 () {56 vars in 1145 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:11.651730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d74fa4-251a-401e-b985-50fbbb659d89 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.652049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d74fa4-251a-401e-b985-50fbbb659d89 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.652292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d74fa4-251a-401e-b985-50fbbb659d89 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.654210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 356/681] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:11.659499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.660052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.660606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.689731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:11.691245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:11.703375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 326/682] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:11.739867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d74fa4-251a-401e-b985-50fbbb659d89 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.758811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d74fa4-251a-401e-b985-50fbbb659d89 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.766896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.767920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.768419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.768932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.786718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:11.793913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:11.795645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 357/683] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:11.802273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.818695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ead01-1579-4112-8624-5a71abd6f98e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.827137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.828187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.828700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.829199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.830169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:11.830672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:11.832512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:11.844042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 327/684] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:11.849754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.859748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf30f-dcb2-4c0f-9817-a1bb80c7ce28 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.868828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.870519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.871005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.871481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.887744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:11.889882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:11.912493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:11.913945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 358/685] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:11.919633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.933413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9dac8-f394-4727-8fd9-b72b1a379205 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.941541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36968876-056b-4346-894b-63852071f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.942491 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36968876-056b-4346-894b-63852071f830 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.943474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36968876-056b-4346-894b-63852071f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.943943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36968876-056b-4346-894b-63852071f830 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.944913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36968876-056b-4346-894b-63852071f830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:11.945414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36968876-056b-4346-894b-63852071f830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:11.947184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36968876-056b-4346-894b-63852071f830 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:11.959993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 328/686] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:11.965094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:11.981462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0cb5a-8ef6-4c12-926e-b45755353dc1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:11.986583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:11.987631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:11.988110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:11.988666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:11.999276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.001871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.016169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:12.017888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 359/687] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:12.025779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36968876-056b-4346-894b-63852071f830 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.041931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36968876-056b-4346-894b-63852071f830 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.048272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.049240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.049722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.050246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.051327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.051905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.054667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.078073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 329/688] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:12.083723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.099606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8239b2-12f8-4ebc-9538-af944b211dce admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.121237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf495d2-cd16-4112-99e2-5ddc66de1b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.121832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf495d2-cd16-4112-99e2-5ddc66de1b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.122117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf495d2-cd16-4112-99e2-5ddc66de1b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.122394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf495d2-cd16-4112-99e2-5ddc66de1b1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.136575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf495d2-cd16-4112-99e2-5ddc66de1b1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.138373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf495d2-cd16-4112-99e2-5ddc66de1b1e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.157291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 360/689] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:12.177509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.199236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b875a-0752-4d4f-a6e3-1321150ea340 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.221758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.222968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.223504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.224582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.236366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df9d8e-4fd8-46c4-8846-e0bcf0910765 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.244589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df9d8e-4fd8-46c4-8846-e0bcf0910765 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.244589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df9d8e-4fd8-46c4-8846-e0bcf0910765 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.244589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 361/690] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:12.244589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.244874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.245153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.248946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.251384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.282693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:12.288567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:12.291734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:12.296349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 330/691] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:12.299737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 362/692] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:12.301457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.312542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8c8e-b33f-42e2-a8f2-6021b5c37139 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.320390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.321394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.321927 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.322478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.323415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.323937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.325884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.337840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.347357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461318cc-c490-431e-980e-0ed8351a5c76 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.354077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 331/693] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:12.357140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.358239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.358782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.359320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.369632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.381065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22394-faa4-4cc8-8d2c-b238635a10e9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.386337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.387395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.387878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.388369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.389337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.391202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.397466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.399663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.414705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:12.416522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 332/694] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:12.418116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:12.419406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 363/695] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:12.428952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.438832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dbea4-4488-4504-af9b-2b0d62b3b45b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.441733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.453861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c223-66c0-4dd4-8584-ef1b6ef09171 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.462653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.468467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.468467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.468748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.468748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.468748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.468748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.469019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.469019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.469019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.472456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.472621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.472621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.474755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.498906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 333/696] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:12.499733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 364/697] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:12.505648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.517489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.539418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423275-62f1-46d6-9dd3-7c099d84ddf0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.539604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f724b7-4914-42f3-8a8b-b47fda340870 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.544251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.544928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.545036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.545253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.548475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.548603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.548603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.548603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.548801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=8a526052e42248f3a38b329084dd262c) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.548801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.548924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.549001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aeb1d-dcbe-4592-8ade-c55bcc08c25d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.553189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.573164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 365/698] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/role_assignments?user.id=8a526052e42248f3a38b329084dd262c&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:12.627207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81128e-1419-44e9-b5d7-959ae8ff9c67 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.627684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81128e-1419-44e9-b5d7-959ae8ff9c67 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.627806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81128e-1419-44e9-b5d7-959ae8ff9c67 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.629834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 366/699] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:12.638527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.638759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.638964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.653926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 334/700] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:14:12 2022] POST /identity/v3/users => generated 254 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:12.670487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:12.671708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:12.687043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 367/701] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 01:14:12.737399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.754471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5b073-c201-4340-a396-83f2148ce68d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.765840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.766981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.767425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.767840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] PATH_INFO: `/v3/services/network` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.772944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.775036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.807116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 01:14:12.811259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 335/702] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/services/network => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:12.818233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.834070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521ba19-4ce9-475a-9e0b-1a2190d71817 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.844404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.845108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.845393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.845672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.846392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.846699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.848312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b3552-6e0f-40e2-ad6b-9eb2aa58dfe1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.862000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 368/703] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:12.867889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:12.887296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd634e87-f9a8-436a-aa93-ee7998fd2b9c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:12.900145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:12.901215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.901804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.902270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.903224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:12.903754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:12.905639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceb911-6556-4915-af54-2abb142ca960 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:12.915156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 336/704] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:12.945646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24402b8-61be-4237-8025-9b8ecdea06ca None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.946165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24402b8-61be-4237-8025-9b8ecdea06ca None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.946272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24402b8-61be-4237-8025-9b8ecdea06ca None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.948336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 369/705] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:12.954013 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:12.954523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:12.954727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:12.975798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:12.977166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:12.985828 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 337/706] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:13.009818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24402b8-61be-4237-8025-9b8ecdea06ca None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.023826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24402b8-61be-4237-8025-9b8ecdea06ca None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.029308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.030284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.030636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.031004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.043738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:13.051377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:13.053128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 370/707] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:13.060760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.070961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88c43-761a-4d92-889d-cf5d4cc64ab2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.076560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.077417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.077739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.078115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.078977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:13.079386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.081151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.091155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 338/708] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:13.096325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.111216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7aca04-0ed6-4627-8786-149e932d3922 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.117586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.118381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.118711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.118986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.132089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.133976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.150389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:13.151808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 371/709] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:13.157271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.167071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c6437-51ac-410e-b1cc-09a893541e75 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.172982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.177174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.177174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.177174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.177174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:13.177174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.177618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.189851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 339/710] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:13.196160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.206984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746179d9-5742-4347-bd58-789189e98b74 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.216604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.222482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.222482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.222482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.233584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.235752 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.252748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:14:13.254216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 372/711] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:13.260194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.275289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d361f9-7bb5-4e3d-9526-3a9ede67cd55 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.282696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.283417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.283694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.283965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.284974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:13.285280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.287257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.314993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 340/712] 10.222.0.90 () {56 vars in 1156 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:13.320993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.333320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771200fa-7552-41f3-b827-b9af49633e93 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.344178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.344864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.345155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.345436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.360104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.361932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.374113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 373/713] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:13.380470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.393616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4573ce-ffa7-48ce-b9db-4f2bb4061e89 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.402954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.403737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.404023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.404298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.420409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.422496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.445000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:13.446495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 341/714] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:13.451873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.461107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83cff5-0a93-4fbf-8f7d-dfe42bcea649 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.465638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.466337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.466618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.466943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.467671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:13.467975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.469640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.486689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 374/715] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:13.492551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.502656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf19a3-1ed5-4980-8f80-327406ffb52a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.511469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.512311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.512674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.512951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.521571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.523522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.539954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:13.541163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 342/716] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:13.546888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.557008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c681d-c507-4e4b-a23c-9ed2302bbbeb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.570100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.570759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.571094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.571368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.572150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:13.572536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.574445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cf796-30f0-48cc-bf18-302c3e87f1c4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.591281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 375/717] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:13.597182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:13.608192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566387-10a7-470e-97de-155f98ea2106 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:13.612751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:13.613446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:13.613730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:13.614004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:13.614939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=f126d69c4bcf42aaa7d5b85e40e93582) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:13.615246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:13.617223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91459562-461e-41c0-ab52-5da341e57293 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:13.623729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 343/718] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:13 2022] GET /identity/v3/role_assignments?user.id=f126d69c4bcf42aaa7d5b85e40e93582&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:14.347369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c2e7-a943-42e2-93e8-ea5b7e1a5598 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:14.347888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c2e7-a943-42e2-93e8-ea5b7e1a5598 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:14.348007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c2e7-a943-42e2-93e8-ea5b7e1a5598 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:14.350013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 376/719] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:14.357992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ec6a-8f2c-45be-8e87-5e1e21d31608 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:14.358563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ec6a-8f2c-45be-8e87-5e1e21d31608 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:14.358563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ec6a-8f2c-45be-8e87-5e1e21d31608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:14.390271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-43e9ec6a-8f2c-45be-8e87-5e1e21d31608 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:14.392035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-43e9ec6a-8f2c-45be-8e87-5e1e21d31608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:14.405460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 344/720] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 01:14:14.442888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8c2e7-a943-42e2-93e8-ea5b7e1a5598 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:14.457994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8c2e7-a943-42e2-93e8-ea5b7e1a5598 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:14.462412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:14.463121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:14.463405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:14.463685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:14.464418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:14.465453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:14.465453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:14.465453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:14.466332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88a8ae-979f-470b-90a7-7c5fea1d228b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:14.586098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 377/721] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:14 2022] POST /identity/v3/services => generated 251 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:15.073267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aabca-8339-45c6-a69c-8213c0d5f788 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.073705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aabca-8339-45c6-a69c-8213c0d5f788 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.074190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aabca-8339-45c6-a69c-8213c0d5f788 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.077620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 345/722] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:15.083217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.083750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.084257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.110340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:15.112295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:15.150082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 378/723] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:15 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:15.176079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aabca-8339-45c6-a69c-8213c0d5f788 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.190370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aabca-8339-45c6-a69c-8213c0d5f788 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.195249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.196284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.196818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.197319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.208771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:15.215897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:15.217612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 346/724] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:15.224154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.233980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ccde2-ad87-481d-bd37-3d7379ea1a16 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.239755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.240747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.241235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.241714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.242693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:15.243205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.245053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.254806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 379/725] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:15.260553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.272984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb021c57-1539-4787-b98a-df2feaf721d3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.286987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.288357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.288886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.289379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.310827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.312719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.340283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:15.341475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 347/726] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:15.347237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.366209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12ed38-6d28-4d71-b5fa-3cacd1fe819f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.389156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.390183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.390672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.391150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.392100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:15.392639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.394477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.412416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 380/727] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:15.418241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.428014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e07d-bbed-4734-a2b4-0476d1bc8f8e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.440726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.441506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.441784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.442053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.452195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.454224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.473420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:15.475154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 348/728] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:15.480862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.493899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133466f9-fa4e-4492-b135-916f166a203a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.509064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.510028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.510517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.510996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.512073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:15.512630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.514704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.534215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 381/729] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:15.540394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.554080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8876b1e-5a9d-426e-b0a8-cfff5eb57a37 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.564340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.565417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.565970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.566445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.579603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.581755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.602564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:15.604318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 349/730] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:15.610706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.640458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc03d4d-3efe-4164-8c04-ea5282c728bb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.655557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.656722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.657223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.657715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.659071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:15.659619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.663210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.694849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 382/731] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:15.700275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.717494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7912-8d8b-4ee3-b298-882b95640c68 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.729476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.730623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.731152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.731653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.745570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.747869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.767092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:15.768938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 350/732] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:15.775459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.790326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a468-2866-419d-8f7b-b8e9a02a01a9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.800595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.801339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.801630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.801896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.802692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:15.803009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.804926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f7f64-cb63-4ec7-8070-7a301d58775a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.830149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 383/733] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:15.836537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:15.851012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f29f0-b912-48e0-89f6-33611643fb0f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:15.860338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c64d-4cf2-4217-a8ab-1821b2d9ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:15.861517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c64d-4cf2-4217-a8ab-1821b2d9ce00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.862062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c64d-4cf2-4217-a8ab-1821b2d9ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.862550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c64d-4cf2-4217-a8ab-1821b2d9ce00 admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/8a526052e42248f3a38b329084dd262c/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.869755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c64d-4cf2-4217-a8ab-1821b2d9ce00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=8a526052e42248f3a38b329084dd262c, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:15.872769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c64d-4cf2-4217-a8ab-1821b2d9ce00 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:15.930721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c27e6b-5f5c-44ab-ba18-65bb29305786 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.931029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c27e6b-5f5c-44ab-ba18-65bb29305786 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.931279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c27e6b-5f5c-44ab-ba18-65bb29305786 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.933336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 384/734] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:15.938145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:15.938434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:15.938707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:15.957126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:15.958869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:15.966990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 385/735] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:15 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:15.974904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 351/736] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:15 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/8a526052e42248f3a38b329084dd262c/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:15.991031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.000650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527b743-06b9-489b-948e-20024ea3a6f1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.069425 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7405d-dc76-488c-89e5-558a6825099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.070191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7405d-dc76-488c-89e5-558a6825099e admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.070526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7405d-dc76-488c-89e5-558a6825099e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.070866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7405d-dc76-488c-89e5-558a6825099e admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.071704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7405d-dc76-488c-89e5-558a6825099e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.073439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7405d-dc76-488c-89e5-558a6825099e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.164137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 386/737] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:15 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:16.322419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b967-592f-4bfd-8ac4-072dde0ba037 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.322740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b967-592f-4bfd-8ac4-072dde0ba037 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.322974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b967-592f-4bfd-8ac4-072dde0ba037 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.325163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 352/738] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:16.330674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.331257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.331759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.357143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:16.358717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:16.385540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 387/739] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:16 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:16.422583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b967-592f-4bfd-8ac4-072dde0ba037 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.443267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b967-592f-4bfd-8ac4-072dde0ba037 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.452717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.453528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.453814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.454088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.470983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:16.478536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:16.479953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 353/740] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:16.486513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.502376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279497-2630-442c-9636-727c032ef7b1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.509032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.509714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.509996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.510274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.511039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:16.511348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.513001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.523196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 388/741] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:16.528754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.540070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00609937-d193-4b8d-844b-e0f9d0d32bc3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.545812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.546592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.546926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.547245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.559604 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.561635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.581128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:16.582714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 354/742] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:16.589024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.599219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b83fb-1348-4c34-b114-220d88c5b046 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.603803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.604502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.604796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.605126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.605857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:16.606164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.607767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.626005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 389/743] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:16.632099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.642013 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221fbd-4506-4f9c-aba0-eb5a6b44699a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.647251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.648145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.648450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.648743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.656313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.658364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.688498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:14:16.689922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 355/744] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:16.696039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.706626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909602cb-fe88-4c8a-84af-6e094166a6dc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.713034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.713738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.714024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.714359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.715193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:16.715557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.717509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.739591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 390/745] 10.222.0.90 () {56 vars in 1170 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:16.745077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.757129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0f2d6-8da5-4b34-b0d8-83852359483d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.762934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.763628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.763919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.764197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.775939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.777765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.788452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 356/746] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:16.793882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.806894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcf9d-cf4d-4fee-8c5f-7da787ed7308 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.813976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.814819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.815101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.815377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.832002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.834483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.852915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:16.854429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 391/747] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:16.859953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.869443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db031-2d7a-4bc7-adc7-fe05167bcf55 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.874115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.874763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.875349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.875627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.876399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:16.876740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.878323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.890872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 357/748] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:16.896297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.906205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a555-e58d-4264-a9d6-a8e25b735493 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.910839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.911716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.912002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.912282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.919806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.921882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.943180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:16.944327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 392/749] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:16.949998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:16.961086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021db505-437f-4054-aebf-064f22ebd93f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:16.967346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:16.968063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:16.968350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:16.968646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:16.969494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:16.969803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:16.971777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197498bf-9b38-4579-ad46-64c792a193e3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:16.984950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 358/750] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:16.991483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.005589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e7ef3-5f0f-46ab-a057-3e58b4dce70c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.015171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.015886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.016175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.016465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.017367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=e5e097a1fd9345fca696a23719a81c0d) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.017680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.019670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac10-7052-4a40-a1db-5cce232c7a86 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.028945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 393/751] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:16 2022] GET /identity/v3/role_assignments?user.id=e5e097a1fd9345fca696a23719a81c0d&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:17.153841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fe248-c0bb-4f55-95fc-0c0c3858691a None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.154162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fe248-c0bb-4f55-95fc-0c0c3858691a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.154393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fe248-c0bb-4f55-95fc-0c0c3858691a None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.156296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 359/752] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:17.161777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.162298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.162591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.183348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:17.184623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:17.193802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 394/753] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:17 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:17.229626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fe248-c0bb-4f55-95fc-0c0c3858691a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.245131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fe248-c0bb-4f55-95fc-0c0c3858691a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.250783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.251656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.251939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.252243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.270824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:17.277915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:17.284318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 360/754] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:17.285176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.298311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a94bea-8a06-44e3-9182-6840fb1fd2d1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.306461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.307137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.307416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.307690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.308469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.308796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.310394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.326982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 395/755] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:17.332138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.345456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b8d1b-0fd7-4a74-92dd-19cff2d9ff15 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.353848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.354691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.354972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.355242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.372064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.374030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.392858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:17.394668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 361/756] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:17.400561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.411489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b5790-98e3-402f-9930-f8d8be009d19 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.416477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.417158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.417491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.417767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.418538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.418850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.420575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.434325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 396/757] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:17.439864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.450287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a4e1-5a9a-4f6a-bb3d-7932bd59b8af admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.454892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.455731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.456012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.456287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.465495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.467578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.482153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:14:17.483685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 362/758] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:17.489829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.503961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551098f-853b-402c-b577-b43271541de7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.508725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.509399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.509681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.510010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.510848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.511213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.513171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.538906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 397/759] 10.222.0.90 () {56 vars in 1156 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:17.544626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.555135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf9207-36f1-4ea3-8f86-2851f0015e66 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.559817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.560573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.560856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.561127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.570378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.572264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.581811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 363/760] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:17.587564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.597568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b5a0-47b1-4355-94b4-ba8e2aecf973 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.602863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.603703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.603990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.604266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.618130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.620042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.643033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:17.644588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 398/761] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:17.650869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.665307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4132-68dc-4b79-b8fc-f20a6eb728dc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.678306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.678970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.679303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.679578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.680352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.680716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.682352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.705463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 364/762] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:17.711340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.722683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1a048-9804-4d3d-942b-ea0757bec839 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.729096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.729926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.730208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.730479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.743423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.745422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.773662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-6732a81c-1dd2-4c38-9a93-f60e82f6e36f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:17.773662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 399/763] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:17.777691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.793716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3658-e156-4561-ac40-38bf1b72d45f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.803750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.804406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.804740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.805018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.805853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.806159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.808053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.827286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa123a9-55d9-4516-9ce7-e66b79a592b0 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.827589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa123a9-55d9-4516-9ce7-e66b79a592b0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.827845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa123a9-55d9-4516-9ce7-e66b79a592b0 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.830574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 400/764] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:17.832856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 365/765] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:17.836394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.836951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.837428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.838840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.852176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eef71-d465-4ba8-9efa-91935c4b906a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.863838 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.865032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.865313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.865585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.866414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=f126d69c4bcf42aaa7d5b85e40e93582) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:17.866723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.868614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.874387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:17.875855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:17.882663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 366/766] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/role_assignments?user.id=f126d69c4bcf42aaa7d5b85e40e93582&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:17.893406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 401/767] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:17 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:17.929418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.942921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad02e-92c8-4542-bfd3-944653ab7259 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.951870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.952734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.953016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.953293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.953968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:17.955713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:17.972719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 01:14:17.974340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 367/768] 10.222.0.90 () {56 vars in 1150 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:17.980009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:17.989809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fffe78-0682-464f-954b-65ff8d10bac0 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:17.997720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:17.998408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:17.998686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:17.998954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:17.999678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:18.000239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:18.001893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:18.011482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 402/769] 10.222.0.90 () {56 vars in 1145 bytes} [Mon Feb 21 01:14:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:18.017395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:18.030998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4db3d1-f6c7-4f8f-a92f-d392045ae997 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:18.039457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:18.040128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:18.040412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:18.040713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:18.041426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:18.041736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:18.043330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:18.053217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 368/770] 10.222.0.90 () {56 vars in 1145 bytes} [Mon Feb 21 01:14:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:18.059036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:18.074127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bffedc-e760-4f00-9a95-41602cab6fe0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:18.084938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:18.085617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:18.085896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:18.086168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:18.087035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] RBAC: Adding query filter params (interface=public, service_id=27e601451e674024afea01a229678576, region_id=RegionOne) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:18.087345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:18.088375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:18.088375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:18.088375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:18.089294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc564dd-bed9-4440-a524-e6f4e6954051 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:18.097999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 403/771] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:18 2022] GET /identity/v3/endpoints?service_id=27e601451e674024afea01a229678576&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:18.104592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:18.119490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca815c-f6c5-4030-9ae6-80a01e8b8d7b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:18.129022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3bfa7-6401-45f5-be77-c538b9f6c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:18.129715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bfa7-6401-45f5-be77-c538b9f6c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:18.130047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bfa7-6401-45f5-be77-c538b9f6c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:18.130321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bfa7-6401-45f5-be77-c538b9f6c4fe admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:18.131536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3bfa7-6401-45f5-be77-c538b9f6c4fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:18.133283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3bfa7-6401-45f5-be77-c538b9f6c4fe admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:18.141995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 369/772] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:18 2022] GET /identity/v3/services => generated 772 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.012123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339230-f950-4e78-88ea-10aab6880f13 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.012123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339230-f950-4e78-88ea-10aab6880f13 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.012123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339230-f950-4e78-88ea-10aab6880f13 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.013364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 404/773] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:19.018866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.018866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.018866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.040850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:19.042344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:19.062613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 370/774] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:19 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:19.093612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339230-f950-4e78-88ea-10aab6880f13 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.110213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339230-f950-4e78-88ea-10aab6880f13 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.117091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.117897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.118188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.118472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.130060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:19.141057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:19.142273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 405/775] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:19.148495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.161790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c7d0a-cc7c-4b23-b639-6d8e47b635b3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.172455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.173359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.173798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.174228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.184204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.184204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.184204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.192243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 371/776] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.198085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.211662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5478b-e448-4f48-a88b-2e7790589a30 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.220527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.221414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.221691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.222008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.237607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.239636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.260403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:19.265678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 406/777] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:19.267107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.285380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cc41c-a954-4cd7-8a21-2adb6a6a0330 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.301368 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.302132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.302412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.302732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.303455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.303757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.305476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.318765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 372/778] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.323936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.336256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e04cc-4462-4006-a36f-b7792e186d5a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.343873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.344773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.345048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.345318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.355185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.357296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.376498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ff0c04c8-3809-482a-aa7b-4e1a80bdf7da admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:19.378052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 407/779] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:19.383341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.393352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544cfaf-273f-42cf-8a9e-f9eb220cd8e1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.400647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.401348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.401630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.401954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.402779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.403133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.406524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.426031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5805d-5a9c-43cf-a10b-afe72c281886 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.426691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5805d-5a9c-43cf-a10b-afe72c281886 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.427189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5805d-5a9c-43cf-a10b-afe72c281886 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.429409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 408/780] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:19.434579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 373/781] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.438685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.439201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.439688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.440908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.467304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000030d1-01a7-4ea4-a96b-cbc61e145566 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.468704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:19.470880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:19.478823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.480301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.481754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.483443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.490854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 409/782] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:19 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:19.498586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.500984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.513969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 374/783] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:19.519771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.520182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.529907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed78876-9ea0-4122-96ec-af37c251dc1d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.534434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc42a-c098-4654-8784-7edef2c0c9ba admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.534897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.536019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.536600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.537118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] PATH_INFO: `/v3/services/network` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.538008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.539217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:19.539217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:19.539217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:19.540513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.549061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.549851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.550137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.550415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.554757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 01:14:19.556120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 410/784] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:19.561918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.570358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.572206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.572408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb84da7-8c86-4a16-b8c1-54cce68ea8ba admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.577253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.578121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.578604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.579097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.580009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] RBAC: Adding query filter params (name=network) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.580555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.582337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.587475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 411/785] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:19.592901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.596046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:19.603548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30544e93-726f-41bb-b5c5-a0c53f27a4fd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.604905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 375/786] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:19.605778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.608793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.609735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.610219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.610740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.611634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.612169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.614817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.622560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 412/787] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:19.627181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae82b08-686a-40e3-aad6-9e88a32dd376 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.628907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.639754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8af06-6696-4fc9-be1f-1e67a0527bb7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.641535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.642287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.642575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.642854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.643685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.644016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.645825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.646489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.647364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.647905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.648382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.649475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] RBAC: Adding query filter params (interface=public, service_id=f5553930c0204f3f90dd83e760aeedd5, region_id=RegionOne) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.650030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.651926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.657983 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 413/788] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/endpoints?service_id=f5553930c0204f3f90dd83e760aeedd5&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:19.663885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.671288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 376/789] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.674318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8403487-16cd-4506-bfc9-ae5a83540875 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.676446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.687486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.688472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.688957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.689508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.690381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.693400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.697869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1a26-aefd-4bb3-ac71-e009ff116ab8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.704331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 414/790] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/services => generated 772 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:19.706688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.707677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.708147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.708629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.716853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.719167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.734441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:19.736282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 377/791] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:19.745711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.756338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3a47-c2ae-4b44-bbed-f08aa001db8e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.768065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.769068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.769522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.769993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.771032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.771535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.773679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67677a3d-b356-4843-9e6c-2221c1fc5cab admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.787496 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 415/792] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.795431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.807465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd50ef-97ab-4663-a938-163222707ae3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:19.813485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:19.814457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.814913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.815327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.816345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=8a526052e42248f3a38b329084dd262c) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:19.816868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:19.819508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35e3d-95da-4baa-88f0-e854146d8cfb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:19.829883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 378/793] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/role_assignments?user.id=8a526052e42248f3a38b329084dd262c&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:19.905557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee71cf-c6e2-42af-bc4b-93dd4e90047a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.906076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee71cf-c6e2-42af-bc4b-93dd4e90047a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.906524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee71cf-c6e2-42af-bc4b-93dd4e90047a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.908915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 416/794] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:19.915117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:19.915641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:19.916087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:19.942451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:19.943957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:19.955036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 379/795] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:19 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:19.978672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee71cf-c6e2-42af-bc4b-93dd4e90047a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:19.993404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee71cf-c6e2-42af-bc4b-93dd4e90047a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.001819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.002996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.003445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.003864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.018499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:20.027061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:20.028861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 417/796] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:20.034841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.045461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba9af-37a9-454d-9f21-576414dd5ab6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.050444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.051285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.051760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.052198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.053156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:20.053648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.055374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.065376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 380/797] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:20.072464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.085044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab443-2bd8-44f1-8dd8-e9b629e2c104 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.091910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.092778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.093064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.093341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.107824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.109810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.128838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:20.130916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 418/798] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:20.136195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.146438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e504308-0b5d-4867-8890-d2cec45ad3c1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.153086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.154169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.154592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.155000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.156104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:20.156662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.159232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.180132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 381/799] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:20.186311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.197754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906957-3152-465d-a879-4104ef6eac92 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.202531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.203340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.203682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.203967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.212351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.214435 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.229653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:14:20.231149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 419/800] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:20.236414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.247139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8d6d8-db50-4c94-a5ed-37fda7083b55 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.252071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.252804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.253085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.253361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.254253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:20.254670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.257195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.275435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 382/801] 10.222.0.90 () {56 vars in 1170 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:20.280643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.291046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c7c20-426d-4af3-9a95-bfef5120c080 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.295836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.296674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.297007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.297284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.308962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.310871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.328407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:20.329962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 420/802] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:20.335107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.346907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f167ba-fa95-4765-b350-8f1841502a04 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.352970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.353643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.353978 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.354257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.355063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:20.355370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.357178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.376520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 383/803] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:20.381749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.397790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9fdb8-57b8-4fb4-85ae-5fb60bbd5b4c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.403583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.404375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.404745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.405020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.416151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.418298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.435857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:20.440530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 421/804] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:20.442651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.457400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250328-4e62-4602-9c9f-025312dd9fcf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.465157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.465809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.466092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.466420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.467212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:20.467572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.469538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67584a-c6f4-4153-b45e-7dfe8a7b4c07 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.490284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 384/805] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:20.495628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.511714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d23d47-ec23-4bdd-8fdc-3f63c6d5b4ca admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.520043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcc2fc-f999-44c3-9c27-81ad78d65bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.520986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcc2fc-f999-44c3-9c27-81ad78d65bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.521254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcc2fc-f999-44c3-9c27-81ad78d65bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.521527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcc2fc-f999-44c3-9c27-81ad78d65bbe admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/e5e097a1fd9345fca696a23719a81c0d/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.542838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcc2fc-f999-44c3-9c27-81ad78d65bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=e5e097a1fd9345fca696a23719a81c0d, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:20.545463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcc2fc-f999-44c3-9c27-81ad78d65bbe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:20.652144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 422/806] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:20 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/e5e097a1fd9345fca696a23719a81c0d/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:20.798183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3e951-d32f-467c-9556-68b42a7f8b9f None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.798496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3e951-d32f-467c-9556-68b42a7f8b9f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.798664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3e951-d32f-467c-9556-68b42a7f8b9f None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.800872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 385/807] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:20.806857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.807151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.807428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.831405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:20.833290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:20.912582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 423/808] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:20 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:20.933029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3e951-d32f-467c-9556-68b42a7f8b9f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.949465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3e951-d32f-467c-9556-68b42a7f8b9f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.955918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.956785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.957069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.957398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:20.968526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:20.975671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:20.977284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 386/809] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:20.982847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:20.993889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7bc9-498b-4e9e-afff-61735975dd64 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:20.998415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:20.999069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:20.999342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:20.999609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.000635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.000937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.002533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.016542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 424/810] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:21.020271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.030291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403454-2261-41e9-8850-7053ad61efcb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.035016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.036992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.037469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.037926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.050680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.052847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.069954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:21.075919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 387/811] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:21.077472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.091832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50162b-3493-4141-82c4-8645a5b492cb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.096756 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.097636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.098091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.099077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.099968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.100466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.102233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f0090-f96c-4fca-a152-099f0e06dc33 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.121180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 425/812] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:21.126878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.137386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5e6e-6660-47f4-bf30-8814533d107a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.149097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.150125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.150600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.151044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.159563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.161837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.168380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad986fd2-f94c-42d8-8ac9-d09aa48ee8a5 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.168380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad986fd2-f94c-42d8-8ac9-d09aa48ee8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.168380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad986fd2-f94c-42d8-8ac9-d09aa48ee8a5 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.168380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 426/813] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:21.181916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:14:21.183420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 388/814] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:21.187653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.188003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.188224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.194294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.216969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a350073-fe26-4d14-b727-3adbb98edcab admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.218488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:21.219680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:21.225594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.226265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.226542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.226812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.227637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.227942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.228739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 427/815] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:21 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:21.229860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.252454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.262480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68573-372c-4c3a-ab8c-0be53158ae91 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.264059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 389/816] 10.222.0.90 () {56 vars in 1156 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:21.267356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.268237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.268635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.268989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.269728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.269828 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.272079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.284866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 01:14:21.285821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9008d72-30cb-4f7e-8733-6692ea2fd5e2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.286665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 428/817] 10.222.0.90 () {56 vars in 1150 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:21.292387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.302656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.303325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49155-cb2c-4b96-82f8-d841c9e1dbec admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.303516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.303667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.303900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.308113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.308921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.309480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.310011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.311189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.311731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.314093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.319822 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 429/818] 10.222.0.90 () {56 vars in 1145 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:21.323986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.325137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.325837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.334780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999f87-ac36-4596-ac1c-8c728eb93a9a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.340798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.341432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.341718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.341994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.342693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.343002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.344858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.350222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 430/819] 10.222.0.90 () {56 vars in 1145 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:21.355332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.358826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:21.364721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 390/820] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:21.365216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b6f8-7268-4eea-8263-242b7b5cbf42 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.369983 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.370622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.371081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.371281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.371809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.371983 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.372909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:21.372909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:21.372909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:21.373795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.391002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b7ae-25b0-42ba-a733-e7247f1af840 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.396250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.397022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.397347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.397737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.398515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.398824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.400662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.414204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 391/821] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:21.421544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.432703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f2c20-f1e3-4c00-91fb-353aaaf247f9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.437811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.439137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.439599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.440129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.447450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.449585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.464470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:21.471850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 392/822] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:21.471850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.482515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc822f6-ae5e-4c79-a3c8-f90c59806f30 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.487267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.488060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.488571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.489038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.489984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:21.490442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.492843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d0bf9-91b6-4bd1-b064-bc761f7df9c5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.502097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 431/823] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:21.512994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 393/824] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:21.519428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:21.543552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8eada-d10e-40d8-b23a-c5cbdb22ecdc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:21.548922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f09bd-83b2-484e-916a-dad285618fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:21.550211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f09bd-83b2-484e-916a-dad285618fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:21.550685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f09bd-83b2-484e-916a-dad285618fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:21.551150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f09bd-83b2-484e-916a-dad285618fe3 admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/f126d69c4bcf42aaa7d5b85e40e93582/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:21.553851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f09bd-83b2-484e-916a-dad285618fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=f126d69c4bcf42aaa7d5b85e40e93582, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:21.557097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f09bd-83b2-484e-916a-dad285618fe3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:21.638935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 432/825] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:21 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/f126d69c4bcf42aaa7d5b85e40e93582/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:22.633682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba315b-d1df-4507-b5e0-067efaef6054 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.634146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba315b-d1df-4507-b5e0-067efaef6054 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.634248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba315b-d1df-4507-b5e0-067efaef6054 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.636263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 394/826] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:22.641407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.641811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.641995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.664171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:22.665377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:22.741218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 433/827] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:22 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:22.777303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba315b-d1df-4507-b5e0-067efaef6054 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:22.797074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba315b-d1df-4507-b5e0-067efaef6054 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:22.801595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:22.802379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.802654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.802921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.803563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:22.805174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:22.820748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 01:14:22.826357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 395/828] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:22 2022] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:22.827779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:22.837036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929bb9-dccf-4dd5-b470-05e6ed363a4e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:22.849239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:22.850161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.850637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.851171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.852089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:22.852625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:22.854429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:22.859793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 434/829] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:22.865782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:22.881589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65805ed-8937-48c5-b702-0fe8b5b23b49 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:22.890034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:22.890686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.890967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.891239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.891938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:22.892240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:22.893841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a32bb-af0f-4fa4-be79-7e7c325a76a4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:22.903516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 396/830] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:22.908859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:22.919580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fafa3-6a46-4f8d-83ad-088edd0b1067 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:22.929739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:22.930628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.931137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.931603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.932618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:22.933114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893d9c-8bf3-43c7-be60-bc91d897e085 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.933397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893d9c-8bf3-43c7-be60-bc91d897e085 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.933668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893d9c-8bf3-43c7-be60-bc91d897e085 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.935172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:22.935675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 397/831] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:22.940285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:22.940581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:22.940852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:22.965337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:22.966501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:22.975303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 398/832] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:22 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:22.997248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.006715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec4c4-44fd-4bb1-b4e3-0597447e2eac None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.011486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.012348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.012723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.013004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.013888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.015553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.028647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 01:14:23.030301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 399/833] 10.222.0.90 () {56 vars in 1153 bytes} [Mon Feb 21 01:14:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:23.036942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.038776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 435/834] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:23.047930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b3468-fc6d-459d-ac05-e14af79bda39 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.075457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.076184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.076502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.076784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.077611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:23.077927 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.079806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c90fcc-e45c-4950-ae49-383040a88fc6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.086060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 400/835] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:23.093556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.110746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b7201-e658-483e-a3cd-3c8fe2b8f09d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.121018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.122034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.122467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.122891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.123766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:23.124222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.126496 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afeb1f-ceb0-4981-a1b1-9a673d556fde admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.140551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 436/836] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:23.662808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be291378-f156-4f42-b1e5-b08ab80f9233 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.663653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be291378-f156-4f42-b1e5-b08ab80f9233 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.664093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be291378-f156-4f42-b1e5-b08ab80f9233 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.666012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 401/837] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:23.671336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.672186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.672787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.692372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:23.693909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:23.702203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 437/838] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:23 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:23.726265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be291378-f156-4f42-b1e5-b08ab80f9233 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.738939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be291378-f156-4f42-b1e5-b08ab80f9233 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.743585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.744648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.745144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.745633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.756586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:23.763617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:14:23.765298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 402/839] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:23.771638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.780998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4dfa1-0e1b-4cc6-9b63-3eaae053261d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.786432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.787321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.787812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.788286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.789242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:23.789739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.791558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.804610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 438/840] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:23.806281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.816938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987a31-115b-4c47-b184-2767beb2d0b7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.821651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.822694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.823180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.823646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.834647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.836823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.854477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:23.856274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 403/841] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:23.861899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.871972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938de0-45bf-470f-8e61-61c860ce1d66 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.877064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.878010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.878530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.879029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.879960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:23.880532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.882390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.894966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 439/842] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:23.901228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.912134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248115b9-5c1d-4148-a24f-1b541a28bb9c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.917165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.918247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.918779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.919246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.927868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.930157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.945659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:14:23.947381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 404/843] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:23.953085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:23.963205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f95b7e-eddf-4995-9c1d-11dc615354f6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:23.968042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:23.968990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:23.969470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:23.969937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:23.970960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:23.971458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:23.973674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:23.992557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 440/844] 10.222.0.90 () {56 vars in 1170 bytes} [Mon Feb 21 01:14:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.007439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.018391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4407-cbb9-491e-88b8-87a733c10b00 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.023819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.024920 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.025401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.025867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.034829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.037490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.046816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 405/845] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:24.053090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.063207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab07ea-2b79-4a70-90c1-460c1cfcb63f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.068100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.069157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.069658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.070127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.080923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.083084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.100301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:24.102012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 441/846] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:24.107566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.117455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f742-0c92-4a27-a49d-4b3ba587d3ce admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.122347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.123251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.123729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.124216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.125424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.125923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.127688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.140028 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 406/847] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:24.145744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.155663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6179f-f7a0-45d4-83b2-4eb79f3fdb8a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.160380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.161948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.162441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.162907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.170154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.172493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.186237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:24.187733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 442/848] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:24.193355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.203042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd9c34-80d7-42db-81de-c5c2f456c064 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.207657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.208377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.208752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.209089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.209943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.210319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.212233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f1db-22fa-43ce-8c2f-5850588807a2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.225649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 407/849] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:24.231604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.244301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76d00-62e9-4b65-b94a-1c45c54fd987 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.249161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.249871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.250475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.250814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.251700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=e5e097a1fd9345fca696a23719a81c0d) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.252073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.254072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42635eec-8171-4dc0-9343-bcb040d27187 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.260697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 443/850] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/role_assignments?user.id=e5e097a1fd9345fca696a23719a81c0d&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.382867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4ab89-7e9d-4a34-8c78-ba673e12fd73 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.383364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4ab89-7e9d-4a34-8c78-ba673e12fd73 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.383639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8b89-6589-4742-8ae5-f70bdfda0ede None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.383959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4ab89-7e9d-4a34-8c78-ba673e12fd73 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.384068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8b89-6589-4742-8ae5-f70bdfda0ede None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.384268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8b89-6589-4742-8ae5-f70bdfda0ede None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.386421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 444/852] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:24.386601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 408/852] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:24.392278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.392598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.392825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.392935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.393338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.393752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.413230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:24.413702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:24.414959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:24.415103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:24.423499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 445/853] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:24 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:24.428646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 409/854] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:24 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:24.449298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.451219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.460257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151c0e-f920-4ad8-a83f-91881c79db99 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.461338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267a56-6f45-4400-8b2b-868d9f2bb71e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.465194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.465395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.465670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.467015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.468261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.468737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.469172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.469729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.471438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.474255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.485955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:24.487672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 01:14:24.489831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 410/855] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:24.493753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:24.495432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 446/856] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:24.495875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.503044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.509014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f7b8-84a3-4204-8c80-edcc3853fb87 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.513466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb897c87-8bbc-4b08-9df4-ca0412867201 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.513906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.514875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.515337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.515779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.516528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.516903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.518546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.518849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.519635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.520015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.520915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.521734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.522172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.524058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.524557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 411/857] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:24.530202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.534299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 447/858] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:24.540069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.542046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee4c6-f3cf-4c34-bece-4a19b8eedca3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.547420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.548375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.548375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.548643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.549333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.549631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.551182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.552741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e90f0e-f3c1-4d48-95a7-4a5a21872269 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.557259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 412/859] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.558640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.559546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.559933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.560310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.572561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.574639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.593495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:24.595284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 448/860] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:24.601873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.612055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24774-3e02-4e40-b170-d5d4703d8eeb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.617764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.618175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.618459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.618736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.619472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.619781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.621467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.638020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 413/861] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.643748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.654816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528294-fbb1-4760-98b9-8a709d8e7a77 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.659585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.660451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.660795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.661067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.669812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.671971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.688549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 01:14:24.695204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 449/862] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:24.696675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.706773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b5a9-03f5-42df-982c-b32ce008b2f6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.711573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.712294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.712606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.712944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.713842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.714145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.716054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.735510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 414/863] 10.222.0.90 () {56 vars in 1156 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.741779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.752324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653bf0f-3c15-4340-8394-dd76deacd218 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.758155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.758806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.759106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.759351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.768172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.770056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.782795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 450/864] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:24.787308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.797379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0040e82-dd3d-4e36-835b-c8da6436f731 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.802134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.803060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.803430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.803796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.814447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.816483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.833926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:24.835560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 415/865] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:24.844449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.850479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92280-ed2f-442c-84d6-ab10c1b1ee42 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.855201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.856039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.856546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.857006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.857891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.858373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.860135 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.872257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 451/866] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.878318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.889296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6eb93-429b-4875-8764-ededb91ec7de admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.894334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.895976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.896498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.897015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.904483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.906711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.919999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:24.921814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 416/867] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:24.927704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.937775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dcb0e-cc02-4ffe-8099-eee17016250e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.943216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.944203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.944740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.945307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.946349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.946896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.949082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacfe7d-e547-43b9-9095-87d6281f845c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.962940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 452/868] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:24.968981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:24.980120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa723d-7c4f-42a6-92fc-be58d923f418 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:24.985185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:24.986110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:24.986597 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:24.987065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:24.988107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=f126d69c4bcf42aaa7d5b85e40e93582) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:24.988657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:24.990836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9311602-2223-4e0c-9e76-fa23fcc4a95f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:24.997356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 417/869] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:24 2022] GET /identity/v3/role_assignments?user.id=f126d69c4bcf42aaa7d5b85e40e93582&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:25.644823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7dcf-3d47-4fd7-af59-7fc482339e83 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:25.645682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7dcf-3d47-4fd7-af59-7fc482339e83 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:25.645948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7dcf-3d47-4fd7-af59-7fc482339e83 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:25.647986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 453/870] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:25.653342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013ae6-22d5-432e-9021-c81711763fce None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:25.653631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013ae6-22d5-432e-9021-c81711763fce None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:25.653908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013ae6-22d5-432e-9021-c81711763fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:25.673964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-23013ae6-22d5-432e-9021-c81711763fce None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:25.675170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-23013ae6-22d5-432e-9021-c81711763fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:25.683454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 418/871] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:25 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:25.706872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc7dcf-3d47-4fd7-af59-7fc482339e83 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:25.719430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc7dcf-3d47-4fd7-af59-7fc482339e83 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:25.724471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeb2dc-d6f8-4163-9d90-15f95be849fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:25.725136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeb2dc-d6f8-4163-9d90-15f95be849fd admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:25.725424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeb2dc-d6f8-4163-9d90-15f95be849fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:25.725703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeb2dc-d6f8-4163-9d90-15f95be849fd admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:25.726445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeb2dc-d6f8-4163-9d90-15f95be849fd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:25.728075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeb2dc-d6f8-4163-9d90-15f95be849fd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:25.820781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 454/872] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:25 2022] POST /identity/v3/services => generated 269 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:26.816420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d23a-ad95-4ff7-8786-a94be67ff28b None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:26.817525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d23a-ad95-4ff7-8786-a94be67ff28b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:26.817607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d23a-ad95-4ff7-8786-a94be67ff28b None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:26.819603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 419/873] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:26.824917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38582-703f-4124-bcce-dcf34c62eb02 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:26.825402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38582-703f-4124-bcce-dcf34c62eb02 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:26.825566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38582-703f-4124-bcce-dcf34c62eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:26.845105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-42c38582-703f-4124-bcce-dcf34c62eb02 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:26.846295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-42c38582-703f-4124-bcce-dcf34c62eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:26.863569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 455/874] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:26 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:26.889132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d23a-ad95-4ff7-8786-a94be67ff28b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:26.901467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d23a-ad95-4ff7-8786-a94be67ff28b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:26.905831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:26.906634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:26.906916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:26.907194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:26.916503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9a50-5f06-49c9-88e4-a5af7eca0335 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:26.916790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9a50-5f06-49c9-88e4-a5af7eca0335 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:26.917058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9a50-5f06-49c9-88e4-a5af7eca0335 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:26.919087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 456/875] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:26.920010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:26.925524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:26.926032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:26.927066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:26.928096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:14:26.929592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 420/876] 10.222.0.90 () {56 vars in 1141 bytes} [Mon Feb 21 01:14:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:26.935523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:26.947812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11467f0-2a38-4b04-a52d-e6626853da47 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:26.948117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:26.949232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:26.953751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:26.954632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:26.955221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:26.955770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:26.956797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:26.957299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:26.960472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 457/877] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:26 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:26.962111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:26.971354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 421/878] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:14:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:26.981634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:26.987102 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:26.992759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684bbab-ae39-4372-a0ba-0325fae1873f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:26.998764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:26.999011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf7585-d8d8-4013-beb2-451ff0a8ff19 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:26.999706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.000246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.000588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.005310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.006003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.006280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.006550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.007308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.008336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:27.008336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:27.008336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:27.009912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.013674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.016367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.034650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:27.036642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 458/879] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:27.041883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.052203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3d72-cedb-4c1b-8c35-26d0d938b88f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.056743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.057378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.057665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.057943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.058665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.058974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.060598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.072275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 459/880] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:27.077659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.088670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71956-e44e-455d-a297-071407fd54c6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.093613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.094535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 422/881] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:26 2022] POST /identity/v3/services => generated 251 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:27.094854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.095144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.095421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.105835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.108412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.125633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:14:27.127737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 460/882] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:27.133653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.154571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fdf72-ce82-4fd2-8389-2951d38c8499 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.159253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.159940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.160275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.161136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.161998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.162310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.164205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.184905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 423/883] 10.222.0.90 () {56 vars in 1170 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:27.190914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.201224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3461-29ab-478f-91ea-bebe3f19f595 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.205947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.206606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.206888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.207162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.216038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.217876 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.228584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 461/884] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/auth/tokens => generated 1663 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:27.234606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.245407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755ffd-b147-4f6e-8d36-8d75e5cb1270 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.250393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.251185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.251468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.251748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.263263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.265259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.283316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:27.284932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 424/885] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:27.290998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.300203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00789a4a-4375-4cf5-81cb-cd2bb9ad092b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.306774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.307133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.307403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.307726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.308464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.308827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.310491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726cf5b-01b3-4a36-af11-505e881acae9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.323286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 462/886] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:27.328722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.339324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd1f8f-5604-4961-a3b8-91c27514cb63 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.343810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.344608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.344890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.345179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.352625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.354838 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.369207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:27.370702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 425/887] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:27.375717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc4f4-d3f2-4dcd-804f-fde5b6fb6a56 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.376070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc4f4-d3f2-4dcd-804f-fde5b6fb6a56 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.376322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.376446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc4f4-d3f2-4dcd-804f-fde5b6fb6a56 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.378287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 463/888] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:27.383475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.383759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.384032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.386971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb2c4b-67a1-42be-b7e0-d51ea2d22c19 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.391566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.392265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.392583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.392915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.393697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.394015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.396556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.409165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 426/889] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:27.415553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.418113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:27.419525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:27.425105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec1be-edf8-4445-8141-75f5857d8e81 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.429741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 464/890] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:27 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:27.436455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.436455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.436455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.436455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.436787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] RBAC: Adding query filter params (role.id=458a3aa0f1d94a38a19a6630c143bb06, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=e5e097a1fd9345fca696a23719a81c0d) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.436787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.436787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.441496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 427/891] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/role_assignments?user.id=e5e097a1fd9345fca696a23719a81c0d&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=458a3aa0f1d94a38a19a6630c143bb06 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:27.454420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.465101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48454f-92c9-42b3-8adb-102423be83ea None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.470178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.471378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.471866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.472339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.473863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.475799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.488272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:14:27.490278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 465/892] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:27.496412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.507338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74433ea8-d774-4831-8323-951ce01b6b05 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.512349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.513414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.513901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.514380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.515305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.515812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.517711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc547c-7d5b-4fae-8e35-8f5f42778a77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.524349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 428/893] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:27.530477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:27.541823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205a57-d96a-478f-b20a-8090ae11a718 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:27.546827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:27.547842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:27.548332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:27.548908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:27.549841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:27.550551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:27.552480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db8987-7026-445e-ae2a-80a42ab04d81 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:27.558411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 466/894] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:28.186261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1326e-59c3-4417-a554-87795219ca19 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.186926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1326e-59c3-4417-a554-87795219ca19 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.186926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1326e-59c3-4417-a554-87795219ca19 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.188857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 429/895] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:28.194862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.195271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.195442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.214079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:28.218673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:28.223640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 467/896] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:28 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:28.247808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1326e-59c3-4417-a554-87795219ca19 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:28.261159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1326e-59c3-4417-a554-87795219ca19 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:28.265549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:28.266341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.266623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.266893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.267545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:28.269161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:28.280596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 01:14:28.282083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 430/897] 10.222.0.90 () {56 vars in 1153 bytes} [Mon Feb 21 01:14:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:28.287588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:28.296687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bf8dd-86fc-415d-ab8b-8d26576e04ef None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:28.301775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:28.302471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.302755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.303034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.303745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:28.304052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:28.305717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:28.311056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 468/898] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:28.317466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:28.327537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd2a2-2464-4e2c-8f68-527170412f8f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:28.332675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:28.333348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.333628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.333914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.334629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:28.334932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:28.336576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:28.342315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 431/899] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:28.348088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:28.358008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d220b-c425-4111-92e3-5ddaa41aa7e6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:28.363194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:28.364408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.364733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.365009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.365862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] RBAC: Adding query filter params (interface=public, service_id=57b90243d19244a2b8b54efb6436f7a0, region_id=RegionOne) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:28.366166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:28.367842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ad2a-17c1-4288-b61d-072e099b3cac admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:28.373665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 469/900] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:28 2022] GET /identity/v3/endpoints?service_id=57b90243d19244a2b8b54efb6436f7a0&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:28.379383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:28.390280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0fa4f-8a61-4f2b-86e0-355980704dc1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:28.395284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eb1f2-2bb6-45d1-bdf4-e8fe276d6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:28.395938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eb1f2-2bb6-45d1-bdf4-e8fe276d6abf admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:28.396224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eb1f2-2bb6-45d1-bdf4-e8fe276d6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:28.396535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eb1f2-2bb6-45d1-bdf4-e8fe276d6abf admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:28.397218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eb1f2-2bb6-45d1-bdf4-e8fe276d6abf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:28.398810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eb1f2-2bb6-45d1-bdf4-e8fe276d6abf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:28.405353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 432/901] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:28 2022] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:14:29.500396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9827a-beeb-4ab5-8e6d-c73828c14371 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.501358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9827a-beeb-4ab5-8e6d-c73828c14371 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.501358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9827a-beeb-4ab5-8e6d-c73828c14371 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.503145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 470/902] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:29.509422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.510184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.510184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.529276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:29.530449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:29.544538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 433/903] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:29 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:29.562236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9827a-beeb-4ab5-8e6d-c73828c14371 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:29.574975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9827a-beeb-4ab5-8e6d-c73828c14371 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:29.580171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:29.581027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.581303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.581573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.582234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:29.583913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:29.596061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 01:14:29.603005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 471/904] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:29.604613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:29.618741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061cef7-ce34-4c77-bd54-ab814a8f26a0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:29.623263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:29.623918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.624193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.624496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.625468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:29.625771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:29.627360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:29.636617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 434/905] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:29.638802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:29.649244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d05f-2e10-492f-85df-46fd1b2e0add admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:29.653765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:29.654407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.654682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.654952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.655649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:29.655950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:29.657569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:29.667842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 472/906] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:29.669242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:29.678997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463df47-f799-4fcd-8c5c-4aca68cf3409 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:29.684003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:29.684676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.684959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.685227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.686013 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] RBAC: Adding query filter params (interface=public, service_id=13f0213e035e402bbde3705218bfba47, region_id=RegionOne) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:29.686315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:29.687309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:29.687309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:29.687309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:29.688185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dd97d-b3d5-4951-a4b9-bb1f49d063d9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:29.696301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 435/907] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/endpoints?service_id=13f0213e035e402bbde3705218bfba47&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:29.701557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:29.713292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb7d74-a82a-473c-a247-f145fd783778 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:29.719332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580bfcf-a575-47b2-8b35-648aaf79f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:29.720479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580bfcf-a575-47b2-8b35-648aaf79f4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.721177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580bfcf-a575-47b2-8b35-648aaf79f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.721808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580bfcf-a575-47b2-8b35-648aaf79f4e3 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.723152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580bfcf-a575-47b2-8b35-648aaf79f4e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:29.725912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580bfcf-a575-47b2-8b35-648aaf79f4e3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:29.733291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 473/908] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:14:29.872283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149a77-89f4-4ee0-83ea-6be8be034a38 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.872786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149a77-89f4-4ee0-83ea-6be8be034a38 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.873169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149a77-89f4-4ee0-83ea-6be8be034a38 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.875620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 436/909] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:29.881460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.881885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.882265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.903612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:29.905632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:29.918197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 474/910] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:29 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:29.940945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149a77-89f4-4ee0-83ea-6be8be034a38 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:29.956724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149a77-89f4-4ee0-83ea-6be8be034a38 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:29.961676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d302443-ff28-4d12-a8a1-a396c7f1bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:29.962478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302443-ff28-4d12-a8a1-a396c7f1bc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:29.962759 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302443-ff28-4d12-a8a1-a396c7f1bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:29.963034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302443-ff28-4d12-a8a1-a396c7f1bc0e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:29.975665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d302443-ff28-4d12-a8a1-a396c7f1bc0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:29.983188 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3d302443-ff28-4d12-a8a1-a396c7f1bc0e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:14:29.984723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 437/911] 10.222.0.90 () {56 vars in 1141 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:29.990712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.000789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594c8b-67ee-4486-b96b-f82cf1d8d760 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.006406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.007079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.007362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.007636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.008382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:30.008725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.010326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.016080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d22ac-f2c9-4dc6-ad81-84eb3a4ad022 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.016381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d22ac-f2c9-4dc6-ad81-84eb3a4ad022 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.019666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d22ac-f2c9-4dc6-ad81-84eb3a4ad022 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.019666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 438/912] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:14:30.020852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 475/913] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:14:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:30.024279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.024599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.024881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.026903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.039220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648bfce-97b0-420f-9cde-588b8447017e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.043716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:30.044055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.044926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.045208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.045538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.046173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:30.054525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 439/914] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:30 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:30.064471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.064471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.077241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.082597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:30.084124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 476/915] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:30.086361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac2c29-d71e-4567-8a88-d8d4bfec6587 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.089455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.099325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.100215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.100683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.101172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.102091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.103573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ad28-b1ed-47f6-8aca-02b3c95371cb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.104149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.108871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.109796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.110182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.110530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.111355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:30.111733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.113437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.126561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 477/916] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:30.132031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.142119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e617-bc55-44d4-be45-b0793c5fd03b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.147115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.147911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.148193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.148485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.155931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.158015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.175826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:14:30.182484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 478/918] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:30.182610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 440/918] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:30 2022] POST /identity/v3/services => generated 241 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:30.184003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.198653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7e67-8f54-46a2-b422-c627c051faaa admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.216011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.217252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.217931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.218438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.219623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:30.220194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.222409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.243812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 479/919] 10.222.0.90 () {56 vars in 1170 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:30.250408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.263496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6ebb2-1c30-4623-a77e-a4f7f8c083db admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.268873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.270637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.271194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.271686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.284280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.286732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.307206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:30.309235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 441/920] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:30.315187 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.326848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ac7e1-3f1a-444f-9947-dd80fffe8d3f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.332266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.333525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.334016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.334512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.335513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:30.336042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.338066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.352249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 480/921] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:30.358529 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.369941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9159-55e7-4873-94a1-b6bca97d9227 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.375362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.376147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.376454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.376791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.383912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.385900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.399413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:30.400917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 442/922] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:30.406591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.417202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dab382-25a7-4f5b-b0cb-2564dc9f72da admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.421868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.422526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.422811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.423091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.423882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:30.424197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.426107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4994f-1196-4e42-a6ca-553b3a09d07d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.441225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 481/923] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:30.447035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:30.460710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd5206-782f-402f-9c8b-d685cd2ca9d4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:30.465780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16965-63f8-4e3d-a284-d2768a9e1971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:30.466915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16965-63f8-4e3d-a284-d2768a9e1971 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:30.467380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16965-63f8-4e3d-a284-d2768a9e1971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:30.467834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16965-63f8-4e3d-a284-d2768a9e1971 admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/e5e097a1fd9345fca696a23719a81c0d/roles/458a3aa0f1d94a38a19a6630c143bb06` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:30.470485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16965-63f8-4e3d-a284-d2768a9e1971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=e5e097a1fd9345fca696a23719a81c0d, role_id=458a3aa0f1d94a38a19a6630c143bb06)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:30.474061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16965-63f8-4e3d-a284-d2768a9e1971 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:30.574077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 443/924] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:30 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/e5e097a1fd9345fca696a23719a81c0d/roles/458a3aa0f1d94a38a19a6630c143bb06 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:31.033969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49332c8-6814-49ad-8ba4-fc3a74ad0e81 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:31.034524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49332c8-6814-49ad-8ba4-fc3a74ad0e81 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:31.034524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49332c8-6814-49ad-8ba4-fc3a74ad0e81 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:31.037283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 482/925] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:31.042624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:31.043152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:31.043646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:31.061598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:31.063059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:31.124528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 444/926] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:31 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:31.144677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49332c8-6814-49ad-8ba4-fc3a74ad0e81 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:31.157297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49332c8-6814-49ad-8ba4-fc3a74ad0e81 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:31.161966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:31.162820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:31.163109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:31.163601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:31.164266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:31.165936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:31.178057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 01:14:31.183336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 483/927] 10.222.0.90 () {56 vars in 1153 bytes} [Mon Feb 21 01:14:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:31.185344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:31.195172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c9e65-8a1c-4af6-bfe5-90ddf074c74d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:31.200010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:31.201008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:31.201525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:31.201989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:31.202897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:31.203392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:31.205196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:31.215147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 445/928] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:31.216917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:31.227305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc359-663d-48ab-82fd-e44ae286a6e9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:31.232116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:31.233016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:31.233493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:31.233981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:31.234927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:31.235426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:31.237318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7384c2-4ade-485a-8869-8cad6a2f8898 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:31.247325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 484/929] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:31.248882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:31.259390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07842f47-bd09-45d1-85c3-f283155c1ab6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:31.264324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:31.265220 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:31.265730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:31.266194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:31.267193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:31.268452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:31.268452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:14:31.268452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:14:31.269728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ad6cd-007d-43f9-b7a8-ff28b69abaae admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:31.340865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 446/930] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:32.221845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32330d7b-6394-4dac-94a8-528cce11482a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.221845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32330d7b-6394-4dac-94a8-528cce11482a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.221845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32330d7b-6394-4dac-94a8-528cce11482a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.221845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 485/931] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:32.227942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.228525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.229083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.250414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:32.251998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:32.272114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 447/932] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:32 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:32.296538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32330d7b-6394-4dac-94a8-528cce11482a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.309424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32330d7b-6394-4dac-94a8-528cce11482a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.313885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.314672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.314957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.315231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.315881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.317562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.328862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 01:14:32.330339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 486/933] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:32.336206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.345668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c8593-4b9e-471f-ae7c-25891ab10392 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.351247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.352150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.352714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.353214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.354168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:32.354698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.356693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.363399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 448/934] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:32.369382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.379434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cad42-e7dd-4857-8a01-15a3bbc73d6b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.384052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.384742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.385054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.385298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.386005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:32.386312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.387984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf475f-8e94-4679-b1e1-11f9c55044c2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.393948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 487/935] 10.222.0.90 () {56 vars in 1135 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:32.399473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.409249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc19c32-a00a-4291-8e33-4ad5ea929b28 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.414374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300918-1620-4227-9aaf-2ab62ad32b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.415016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300918-1620-4227-9aaf-2ab62ad32b09 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.415293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300918-1620-4227-9aaf-2ab62ad32b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.415565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300918-1620-4227-9aaf-2ab62ad32b09 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.416308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300918-1620-4227-9aaf-2ab62ad32b09 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.417969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300918-1620-4227-9aaf-2ab62ad32b09 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.500512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 449/936] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:32.586468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b823f-ab19-4fa1-9d16-f3419db876be None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.586797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b823f-ab19-4fa1-9d16-f3419db876be None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.587025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b823f-ab19-4fa1-9d16-f3419db876be None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.589107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 488/937] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:32.594682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.595285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.595765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.615607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:32.617193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:32.635358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 450/938] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:32 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:32.659463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b823f-ab19-4fa1-9d16-f3419db876be None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.678908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b823f-ab19-4fa1-9d16-f3419db876be None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.683936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.685118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.685638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.686119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.686989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.688890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.701634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:14:32.703517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 489/939] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:32.709881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.722420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df666-3bd6-4024-a447-2ce693e17900 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.727613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.728298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.728625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.728951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.729664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:32.730017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.731605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.737011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 451/940] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:32.742447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.752699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4869ee-b930-4f6c-bce6-c0b42c13460b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.757531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.758252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.758537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.758810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.759572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:32.759901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.761632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.767288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 490/941] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:32.773806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.783731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dbd96-e6c3-425d-8b73-8b25bdc9864f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.788616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.789379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.789776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.790124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.791033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] RBAC: Adding query filter params (interface=public, service_id=82a95bcdbae7405f985e5a823665dc70, region_id=RegionOne) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:32.791428 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.793163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcb28a-b292-4ed1-88a2-e058fec80ef6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.798990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 452/942] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/endpoints?service_id=82a95bcdbae7405f985e5a823665dc70&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:32.805146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:32.815664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e5ef-fce9-49f6-aa36-eb21782d0428 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:32.821179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1413-f015-44d3-aa3c-8e3831cc5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:32.822109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1413-f015-44d3-aa3c-8e3831cc5a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:32.822616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1413-f015-44d3-aa3c-8e3831cc5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:32.823161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1413-f015-44d3-aa3c-8e3831cc5a5f admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:32.824035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e1413-f015-44d3-aa3c-8e3831cc5a5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:32.825973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e1413-f015-44d3-aa3c-8e3831cc5a5f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:32.832835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 491/943] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:32 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:14:33.038128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c10ec-56d7-410f-9f62-6265281d418d None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.038584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c10ec-56d7-410f-9f62-6265281d418d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.038874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c10ec-56d7-410f-9f62-6265281d418d None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.040814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 453/944] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:33.046248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.046809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.047289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.065340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:33.067383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:33.075686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 492/945] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:33 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:33.100051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c10ec-56d7-410f-9f62-6265281d418d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.112785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c10ec-56d7-410f-9f62-6265281d418d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.117633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.118705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.119193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.119707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.131475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:33.139377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:14:33.141083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 454/946] 10.222.0.90 () {56 vars in 1141 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:33.147757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.157224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a16d-6ea2-4586-8ba2-9a00a42e93df None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.162213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.163131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.163620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.164131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.165182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.165690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.167552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.176789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 493/947] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:33.182649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.194063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f4ea-b9d3-4dae-8bc0-46a8acf9897b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.199055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.200097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.200605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.201110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.212740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.214812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.232542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:33.234800 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 455/948] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:33.240879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.251623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7ab09-65ee-4509-8ec4-170f81f81559 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.257103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.258045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.258508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.258961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.259912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.260399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.262266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.275953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 494/949] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:33.281938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.292369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d9a8-f8cb-422f-bca5-683ed5c5b11e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.297581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.298639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.299099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.299549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.307489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.309775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.325969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 01:14:33.327488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 456/950] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:33.333792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.344161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ace11-5e37-4fda-a675-6a4bc5233d85 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.349767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.350730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.351266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.351745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.352875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.353398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.355572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.374527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 495/951] 10.222.0.90 () {56 vars in 1170 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:33.380745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.391003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bed548-1c3e-46c6-9ac8-95e6d8a4c6db admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.396590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.397523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.398079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.398569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.407026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.409083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.419128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 457/952] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:33.425093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.435755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fc92-9146-4509-af9f-7fd7e2b9bb9e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.441196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.442416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.442904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.443380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.456538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.459413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.477897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:33.479712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 496/953] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:33.485541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.494889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321701e-281a-460a-a95b-f07d62896b0b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.499965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.501443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.501971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.502447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.503397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.503902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.505803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.518406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 458/954] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:33.524266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.538593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84741951-8afa-40e6-95cc-ace1dfcf90d2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.543684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.544777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.545322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.545800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.553953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.556245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.570091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:33.571883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 497/955] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:33.577842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.588785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c785d-94db-4401-9b1f-29e6f11ef16d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.594983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.595916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.596477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.596970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.598612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.599144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.603002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602b7e-e1d2-48cd-be5d-5ea594305264 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.624505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 459/956] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:33.630826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.642885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a44e-5a50-4a8a-a694-53032cdcecc2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.648259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.648950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.649283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.649562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.650397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] RBAC: Adding query filter params (role.id=458a3aa0f1d94a38a19a6630c143bb06, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=e5e097a1fd9345fca696a23719a81c0d) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.650749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.652723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251621-7d54-4148-b7b4-a87d34e9ceba admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.659564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 498/957] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/role_assignments?user.id=e5e097a1fd9345fca696a23719a81c0d&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=458a3aa0f1d94a38a19a6630c143bb06 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:33.822360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffeaf1-858f-41ae-ba9e-5a451488f002 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.822658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffeaf1-858f-41ae-ba9e-5a451488f002 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.822825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffeaf1-858f-41ae-ba9e-5a451488f002 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.824997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 460/958] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:33.830773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.831084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.831324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.849663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:33.850851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:33.860512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 499/959] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:33 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:33.881611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffeaf1-858f-41ae-ba9e-5a451488f002 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.894256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffeaf1-858f-41ae-ba9e-5a451488f002 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.899274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.900105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.900385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.900737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.901437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.903069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.914374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 01:14:33.920515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 461/960] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:33.922013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.931993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4bc9-f0b6-4d72-a5e1-e1108f7e56af None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.936919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.937590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.937865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.938137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.938851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.939268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.940912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2473658-65e8-4ed4-86ec-c8b4d2c249f5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.951482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 500/961] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:33.952855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:33.964226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b46a-1c29-484e-85bd-1325de494bf4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:33.969050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:33.969735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:33.970020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:33.970346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:33.971044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:33.971346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:33.973765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3668-a83b-46b1-b2a4-e7bb39371a48 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:33.984602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 462/962] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:34.960628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d301-b9f4-4e0c-a0a2-c68fa18d92ec None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:34.961121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d301-b9f4-4e0c-a0a2-c68fa18d92ec None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:34.961121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d301-b9f4-4e0c-a0a2-c68fa18d92ec None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:34.963105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 501/963] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:34.968786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:34.969221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:34.969409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:34.986994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:34.988180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:35.000766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 463/964] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:34 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:35.021175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d301-b9f4-4e0c-a0a2-c68fa18d92ec None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.033457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d301-b9f4-4e0c-a0a2-c68fa18d92ec None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.037911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.038555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.038836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.039374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.039812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.040843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:35.040843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:35.040843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:35.041973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.043328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.common [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 01:14:35.098689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.sql.core [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 21 01:14:35.098689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 21 01:14:35.098689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [parameters: {'id': '69059e84c3c84d4288ab51b9e86d977e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 21 01:14:35.098689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79596) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 01:14:35.116238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 69059e84c3c84d4288ab51b9e86d977e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 69059e84c3c84d4288ab51b9e86d977e. Feb 21 01:14:35.119460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 502/965] 10.222.0.90 () {60 vars in 1161 bytes} [Mon Feb 21 01:14:35 2022] POST /identity/v3/projects => generated 262 bytes in 97 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:35.124077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.134427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14d4e-d2c5-4da9-81f2-bcfe27776623 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.139637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.140577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.140967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.141308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.149511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.151593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.166602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-1fd4798d-1bd9-40d0-bcc6-56aeece0450b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:35.168211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 464/966] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:35.174535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.185806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ba13-ca57-4f51-a124-c555519b014d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.190572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.191222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.191500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.192330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.193118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:35.193422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.195638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78838a-643d-46ee-9a17-24d3c6ffe94e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.217844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 503/967] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:35.328401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be5d2f-9e87-401a-907c-8af2f6aae400 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.329086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be5d2f-9e87-401a-907c-8af2f6aae400 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.329606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be5d2f-9e87-401a-907c-8af2f6aae400 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.331918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 465/968] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:35.338201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.338823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.339313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.359489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:35.361439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:35.371079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 504/969] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:35 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:35.395192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be5d2f-9e87-401a-907c-8af2f6aae400 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.408636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be5d2f-9e87-401a-907c-8af2f6aae400 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.414048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.415090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.415376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.415650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.416309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.417930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.430930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:14:35.432697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 466/970] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:35.438312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.448293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd83ad4-a6c9-46a4-9c10-771217290bd8 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.453377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.454044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.454325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.454603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.455312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:35.455623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.457313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.462678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 505/971] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:35.468350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.479015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399ca5-a35e-404e-be10-1f0915b13c93 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.483716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.484490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.484770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.485042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.485797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:35.486098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.487738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4e44-c9f9-4eaf-8390-4876cb218604 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.494274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 467/972] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:35.499859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:35.510696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb11de-f4ba-429e-ba8d-523c869907c5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:35.515356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec597c-f95b-413a-bffe-0375d5b3ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:35.516000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec597c-f95b-413a-bffe-0375d5b3ff0a admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:35.516283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec597c-f95b-413a-bffe-0375d5b3ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:35.516594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec597c-f95b-413a-bffe-0375d5b3ff0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:35.517347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec597c-f95b-413a-bffe-0375d5b3ff0a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:35.518937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec597c-f95b-413a-bffe-0375d5b3ff0a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:35.598530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 506/973] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:36.101809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38d621-73e9-445a-92a5-eef75a58cebf None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.102349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38d621-73e9-445a-92a5-eef75a58cebf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.102349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38d621-73e9-445a-92a5-eef75a58cebf None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.106000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 468/974] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:36.110043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.110461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.110648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.128953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:36.130662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:36.152786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 507/975] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:36 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:36.171843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38d621-73e9-445a-92a5-eef75a58cebf None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:36.186941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38d621-73e9-445a-92a5-eef75a58cebf None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:36.191288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:36.192643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.193057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.193325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.193973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:36.195557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:36.209509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 01:14:36.211319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 469/976] 10.222.0.90 () {56 vars in 1126 bytes} [Mon Feb 21 01:14:36 2022] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:36.216928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:36.226145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d938-57d5-4cf1-b35d-0233319a63c1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:36.231031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:36.231695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.231977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.232255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.233031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:36.233341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:36.234959 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0abcff-04ee-4138-91c4-3c247b5f1c1c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:36.240664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 508/977] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:36.246347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:36.257468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2b22-d784-46c0-a71f-1b1bd3ef6fb6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:36.262108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:36.262772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.263054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.263329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.264093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:36.264402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:36.266109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8345c8-5e9f-4c4d-8be8-ca86923d4109 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:36.271867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 470/978] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:36.422194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48fca-92a0-4ea1-af30-fc976c6e7f78 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.422563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48fca-92a0-4ea1-af30-fc976c6e7f78 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.422931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48fca-92a0-4ea1-af30-fc976c6e7f78 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.425409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 509/979] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:36.433204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489673-4674-46c3-8815-266ddcf73a24 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.433596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489673-4674-46c3-8815-266ddcf73a24 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.433886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489673-4674-46c3-8815-266ddcf73a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.454478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-69489673-4674-46c3-8815-266ddcf73a24 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:36.456164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-69489673-4674-46c3-8815-266ddcf73a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:36.472559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 471/980] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:36 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:36.491316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48fca-92a0-4ea1-af30-fc976c6e7f78 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:36.504217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48fca-92a0-4ea1-af30-fc976c6e7f78 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:36.509221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec087802-f133-44af-8db2-dd8f0d275b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:36.509884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087802-f133-44af-8db2-dd8f0d275b5f admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:36.510161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087802-f133-44af-8db2-dd8f0d275b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:36.510423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087802-f133-44af-8db2-dd8f0d275b5f admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:36.511160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec087802-f133-44af-8db2-dd8f0d275b5f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:36.512903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec087802-f133-44af-8db2-dd8f0d275b5f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:36.596121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 510/981] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:36 2022] POST /identity/v3/services => generated 242 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:37.746556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aa1ce-8927-4e54-88f5-673d42f91577 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:37.747242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aa1ce-8927-4e54-88f5-673d42f91577 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:37.747242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aa1ce-8927-4e54-88f5-673d42f91577 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:37.749277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 472/982] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:37.756082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:37.756768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:37.756768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:37.776853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:37.778079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:37.795676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 511/983] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:37 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:37.820694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653aa1ce-8927-4e54-88f5-673d42f91577 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:37.832749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653aa1ce-8927-4e54-88f5-673d42f91577 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:37.837156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:37.837804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:37.838080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:37.838351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:37.839040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:37.840907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:37.842194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.common [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 01:14:37.948907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.sql.core [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 21 01:14:37.948907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 21 01:14:37.948907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [parameters: {'user_id': '90175e82e69849deb748dd847c29315e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 21 01:14:37.948907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 01:14:37.954899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 21 01:14:37.956471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 473/984] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:14:37 2022] POST /identity/v3/users => generated 160 bytes in 136 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:37.963036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:37.972345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6de39-f337-4d06-9ab4-98fde0fb8917 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:37.977640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:37.978429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:37.978706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:37.979027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:37.986850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:37.989190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.003827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b38be0b8-afa1-4c61-a191-7cb113bff4d6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 01:14:38.005413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 512/985] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:38.011368 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.022184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a03df-f550-4fbb-89c1-a80879d7c053 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.026806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.027450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.027724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.027992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.028827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:38.029173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.031250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9509e2e-ff03-409f-9b91-f9ab2a175c16 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.071111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 474/986] 10.222.0.90 () {56 vars in 1122 bytes} [Mon Feb 21 01:14:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:38.139766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193063-62e5-4f3d-a16b-89d7e6adea48 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.139766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193063-62e5-4f3d-a16b-89d7e6adea48 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.139766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193063-62e5-4f3d-a16b-89d7e6adea48 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.140699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 513/987] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:38.146837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.147112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.147394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.167030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:38.168674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:38.178128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 475/988] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:38 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:38.202620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193063-62e5-4f3d-a16b-89d7e6adea48 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.216388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193063-62e5-4f3d-a16b-89d7e6adea48 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.221810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.223110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.223862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.224384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.225360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.227294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.241076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:14:38.243091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 514/989] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:38.249663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.259780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a635eb-9b02-4f65-9020-a2057a852013 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.264456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.265135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.266403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.266403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.266403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:38.266731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.268258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.274565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 476/990] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:38.280204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.291593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adfe74-5918-410c-8144-466363e1d3ea admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.296687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.297573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.298040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.298519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.299409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:38.299914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.302299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.307783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 515/991] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:38.313566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.323955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9cdc-7704-444f-a4d3-582ebd64571e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.329174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.329855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.330123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.330390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.331189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] RBAC: Adding query filter params (interface=admin, service_id=82a95bcdbae7405f985e5a823665dc70, region_id=RegionOne) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:38.331497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.333210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbef3-9021-4bac-8c01-dbcaf10bba8c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.339672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 477/992] 10.222.0.90 () {56 vars in 1270 bytes} [Mon Feb 21 01:14:38 2022] GET /identity/v3/endpoints?service_id=82a95bcdbae7405f985e5a823665dc70&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:38.345429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.356265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bad11d-93ef-43ff-9173-e1d1b74f3457 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.361143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7052e-0df4-4086-84e6-8ed61fb36c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.361814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7052e-0df4-4086-84e6-8ed61fb36c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.362146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7052e-0df4-4086-84e6-8ed61fb36c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.362418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7052e-0df4-4086-84e6-8ed61fb36c66 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.363111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7052e-0df4-4086-84e6-8ed61fb36c66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.365413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7052e-0df4-4086-84e6-8ed61fb36c66 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.372728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 516/993] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:38 2022] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:14:38.724106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499e59-17da-40eb-bea2-cb49e4d1b459 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.724389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499e59-17da-40eb-bea2-cb49e4d1b459 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.724884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499e59-17da-40eb-bea2-cb49e4d1b459 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.727249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 478/994] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:38.732671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3e6a-6f3d-47fa-82c9-c3365d5c1cb9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.732964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3e6a-6f3d-47fa-82c9-c3365d5c1cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.733245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3e6a-6f3d-47fa-82c9-c3365d5c1cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.751276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-2cfd3e6a-6f3d-47fa-82c9-c3365d5c1cb9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:38.752483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2cfd3e6a-6f3d-47fa-82c9-c3365d5c1cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:38.760244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 517/995] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:38 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:38.783486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499e59-17da-40eb-bea2-cb49e4d1b459 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:38.796164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499e59-17da-40eb-bea2-cb49e4d1b459 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:38.800588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ad554-3844-40ed-bc78-c3974a819df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:38.801296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad554-3844-40ed-bc78-c3974a819df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.801704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad554-3844-40ed-bc78-c3974a819df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.801980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad554-3844-40ed-bc78-c3974a819df2 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.802711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ad554-3844-40ed-bc78-c3974a819df2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:38.804309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ad554-3844-40ed-bc78-c3974a819df2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:38.871113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 479/996] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:38 2022] POST /identity/v3/services => generated 242 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:38.996055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3be35-6020-414c-a5fe-b0a434bc599c None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:38.996397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3be35-6020-414c-a5fe-b0a434bc599c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:38.996733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3be35-6020-414c-a5fe-b0a434bc599c None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:38.998588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 518/997] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:39.005213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:39.005554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:39.005779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:39.024827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:39.026134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:39.044112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 480/998] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:39 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:39.067484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3be35-6020-414c-a5fe-b0a434bc599c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:39.081979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3be35-6020-414c-a5fe-b0a434bc599c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:39.086996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:39.087780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:39.088061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:39.088333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:39.089038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:39.090637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:39.101911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 01:14:39.103232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 519/999] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:39.109014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:39.118144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eca80-f79d-4df6-b24b-92c605fe59b8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:39.122753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:39.123353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:39.123638 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:39.123915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:39.124649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:39.125013 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:39.126937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:39.132843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 481/1000] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:39.138621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:39.148849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2467f-329c-404a-badb-af728f745f75 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:39.153354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:39.154001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:39.154282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:39.154557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:39.155260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:39.155563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:39.157219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:39.162402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 520/1001] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:39.167952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:39.177718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123688-3a01-47c2-a81b-268f1868a761 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:39.184513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:39.185164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:39.185450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:39.185708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:39.186493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] RBAC: Adding query filter params (interface=public, service_id=f23ba7bc01bb4c138386f61c4b5cb383, region_id=RegionOne) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:39.186798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:39.188371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55558595-59d8-4ea2-a5c3-7a1b17eddbad admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:39.194689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 482/1002] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:39 2022] GET /identity/v3/endpoints?service_id=f23ba7bc01bb4c138386f61c4b5cb383&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:39.199868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:39.210082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ed03-d26d-4272-abb7-8175eafd7f97 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:39.214750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29f77a-5125-4d98-9206-288c3bd83d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:39.215377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f77a-5125-4d98-9206-288c3bd83d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:39.215659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f77a-5125-4d98-9206-288c3bd83d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:39.215934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f77a-5125-4d98-9206-288c3bd83d1b admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:39.216642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29f77a-5125-4d98-9206-288c3bd83d1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:39.218285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29f77a-5125-4d98-9206-288c3bd83d1b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:39.225287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 521/1003] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:39 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:14:40.672579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc673a-c71c-422e-ae01-41c96af78906 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:40.673539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc673a-c71c-422e-ae01-41c96af78906 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:40.673874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc673a-c71c-422e-ae01-41c96af78906 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:40.675618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 483/1004] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:40.681137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:40.681585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:40.681665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:40.699718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:40.700918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:40.709166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 522/1005] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:40 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:40.731535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc673a-c71c-422e-ae01-41c96af78906 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:40.743312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc673a-c71c-422e-ae01-41c96af78906 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:40.747518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:40.748297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:40.748599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:40.748865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:40.749500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:40.751330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:40.762808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 01:14:40.764203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 484/1006] 10.222.0.90 () {56 vars in 1147 bytes} [Mon Feb 21 01:14:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:40.770395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:40.779454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c69e7b-dc58-4bc5-aeee-ab8ba1f3cb3a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:40.783985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:40.784677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:40.784966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:40.785798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:40.786512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:40.786823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:40.788436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:40.794050 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 523/1007] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:40.799645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:40.809959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a8cd8-4720-4c2e-9064-ed14734f27db admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:40.814422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:40.815075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:40.815353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:40.815625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:40.816439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:40.816760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:40.818341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ae15-5a27-4858-afc3-7930ed3261aa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:40.824449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 485/1008] 10.222.0.90 () {56 vars in 1143 bytes} [Mon Feb 21 01:14:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:40.830679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:40.840757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5cd07-d5af-4bb9-8de3-04f980436f23 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:40.845790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57562a30-b2c4-4960-96df-561863ad91b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:40.846567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562a30-b2c4-4960-96df-561863ad91b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:40.846938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562a30-b2c4-4960-96df-561863ad91b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:40.847286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562a30-b2c4-4960-96df-561863ad91b0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:40.848724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57562a30-b2c4-4960-96df-561863ad91b0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:40.850475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57562a30-b2c4-4960-96df-561863ad91b0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:40.940039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 524/1009] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:41.221497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bb7ad-e827-417d-9af4-b581fe4e9f2c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.221839 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bb7ad-e827-417d-9af4-b581fe4e9f2c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.221960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bb7ad-e827-417d-9af4-b581fe4e9f2c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.224455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 486/1010] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:41.229660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.230029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.230387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.248412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:41.249612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:41.267477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 525/1011] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:41 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:41.291193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bb7ad-e827-417d-9af4-b581fe4e9f2c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.303355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bb7ad-e827-417d-9af4-b581fe4e9f2c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.307779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.308587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.308873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.309147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] PATH_INFO: `/v3/services/image` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.309818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.311394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.322834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 01:14:41.324155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 487/1012] 10.222.0.90 () {56 vars in 1126 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:41.330139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.339741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb226e-f599-4b86-a4b8-e595d1d81900 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.344264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.344945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.345230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.345511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.346220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:41.346528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.348179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.353282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 526/1013] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:41.358915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.369005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91988b4f-524b-4ed9-b2ab-968b70f12d6c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.373451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.374098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.374381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.374655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.375621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] RBAC: Adding query filter params (type=image) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:41.375926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.377553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.383649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 488/1014] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:41.389263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.399510 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1fc21-9a48-47a8-9816-68b06980adf9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.403955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.404639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.404927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.405205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.406037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] RBAC: Adding query filter params (interface=public, service_id=62bf7f645f7f46a286f9667acf478b12, region_id=RegionOne) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:41.406357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.407952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293581-02ba-4f8b-a0cd-712e8e9a7de7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.413765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 527/1015] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/endpoints?service_id=62bf7f645f7f46a286f9667acf478b12&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:41.418950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.428942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1edf6-cd6d-4032-b8fa-81770f3052bb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.433398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6986c-8fd4-4e15-bcd8-20d7b92852ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.434044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6986c-8fd4-4e15-bcd8-20d7b92852ab admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.434329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6986c-8fd4-4e15-bcd8-20d7b92852ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.434607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6986c-8fd4-4e15-bcd8-20d7b92852ab admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.435286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6986c-8fd4-4e15-bcd8-20d7b92852ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.436931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6986c-8fd4-4e15-bcd8-20d7b92852ab admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.443557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 489/1016] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:14:41.549159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14aa96-ea33-43cb-861d-5bd3cfd96125 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.549553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14aa96-ea33-43cb-861d-5bd3cfd96125 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.549961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14aa96-ea33-43cb-861d-5bd3cfd96125 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.552513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 528/1017] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:41.558198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.558485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.558757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.577225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:41.579692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:41.586498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 490/1018] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:41 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:41.610289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14aa96-ea33-43cb-861d-5bd3cfd96125 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.629674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14aa96-ea33-43cb-861d-5bd3cfd96125 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.634343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.635340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.635622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.635892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.636595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.638281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.650164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 01:14:41.651332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 529/1019] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:41.657280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.666689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f88d2-cc37-437b-b2e0-2e97e622b0fc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.676230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.676985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.677266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.677536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.678325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:41.678631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.680374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.688466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 491/1020] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:41.691556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.701180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506597a-65a2-4e62-8fd7-085afae23ee7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.705632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.706296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.706588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.706870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.708077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:41.708386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.710044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb1be7-6be5-4b85-9a7b-e8f2b39320ff admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.715223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 530/1021] 10.222.0.90 () {56 vars in 1133 bytes} [Mon Feb 21 01:14:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:41.720690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:41.730966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5495fa-8637-41f2-b5a9-bdab30274c51 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:41.735446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba046bf-5791-446e-b218-740748c86848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:41.736088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba046bf-5791-446e-b218-740748c86848 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:41.736368 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba046bf-5791-446e-b218-740748c86848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:41.736673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba046bf-5791-446e-b218-740748c86848 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:41.737413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba046bf-5791-446e-b218-740748c86848 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:41.739042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba046bf-5791-446e-b218-740748c86848 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:41.849075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 492/1022] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:43.280475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13dbe-d06f-4053-9218-e1f0a60d1947 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.281001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13dbe-d06f-4053-9218-e1f0a60d1947 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.281106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13dbe-d06f-4053-9218-e1f0a60d1947 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.282786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 531/1023] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:43.288858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.289274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.289414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.306995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:43.308191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:43.324361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 493/1024] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:43 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:43.348746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13dbe-d06f-4053-9218-e1f0a60d1947 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:43.360725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13dbe-d06f-4053-9218-e1f0a60d1947 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:43.365027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e3ad-74fe-43a0-bbd7-2d38901b9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:43.365803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e3ad-74fe-43a0-bbd7-2d38901b9eee admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.366083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e3ad-74fe-43a0-bbd7-2d38901b9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.366357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e3ad-74fe-43a0-bbd7-2d38901b9eee admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.367521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e3ad-74fe-43a0-bbd7-2d38901b9eee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:43.369232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e3ad-74fe-43a0-bbd7-2d38901b9eee admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:43.370999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 532/1025] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:43.376706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:43.386650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a9084-b3b4-4ccd-ac4b-cd2487a2e593 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:43.391319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1834aa-a9b0-44ba-a4d9-b28f22e84bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:43.392001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1834aa-a9b0-44ba-a4d9-b28f22e84bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.392281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1834aa-a9b0-44ba-a4d9-b28f22e84bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.392594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1834aa-a9b0-44ba-a4d9-b28f22e84bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.393327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1834aa-a9b0-44ba-a4d9-b28f22e84bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:43.395821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1834aa-a9b0-44ba-a4d9-b28f22e84bfa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:43.520590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 494/1026] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:14:43 2022] POST /identity/v3/projects => generated 311 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:43.756156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c0b6-5df9-49fe-958f-c2a185d2187f None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.756498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c0b6-5df9-49fe-958f-c2a185d2187f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.756747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598c0b6-5df9-49fe-958f-c2a185d2187f None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.758658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 533/1027] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:43.763830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.764123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.764403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.782310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:43.783498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:43.840467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 495/1028] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:43 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:43.862729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598c0b6-5df9-49fe-958f-c2a185d2187f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:43.876056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598c0b6-5df9-49fe-958f-c2a185d2187f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:43.881026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:43.881906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.882256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.882627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] PATH_INFO: `/v3/services/image` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.883379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:43.885070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:43.896185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 01:14:43.897586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 534/1029] 10.222.0.90 () {56 vars in 1126 bytes} [Mon Feb 21 01:14:43 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:43.903446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:43.912477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e457b-3f0b-4d73-893e-b691570f50d2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:43.917039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:43.917761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.918119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.918466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.919240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:43.919613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:43.921299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:43.927607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 496/1030] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:43.932478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:43.943308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678b916-fbd1-4021-821e-3af0fb25684a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:43.947988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:43.948664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.948947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.949218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.949912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:43.950216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:43.951796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b4e0b-ca83-43d1-a046-ddc1614a0d34 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:43.956838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 535/1031] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:43.962401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:43.972071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b2352-6873-49c3-8bed-1cbf6a828685 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:43.976689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746bb6-2615-4973-a28b-796bcf92de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:43.977401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746bb6-2615-4973-a28b-796bcf92de01 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:43.977692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746bb6-2615-4973-a28b-796bcf92de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:43.977969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746bb6-2615-4973-a28b-796bcf92de01 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:43.978716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80746bb6-2615-4973-a28b-796bcf92de01 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:43.980303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80746bb6-2615-4973-a28b-796bcf92de01 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.117168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 497/1032] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:14:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:44.213322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ce43-6d36-4054-afbb-466eff5a3a84 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.213626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ce43-6d36-4054-afbb-466eff5a3a84 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.213809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ce43-6d36-4054-afbb-466eff5a3a84 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.215785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 536/1033] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:44.221425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.221741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.221976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.241105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:44.242305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:44.262176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 498/1034] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:44.286486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32ce43-6d36-4054-afbb-466eff5a3a84 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.299180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32ce43-6d36-4054-afbb-466eff5a3a84 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.303602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.304406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.304716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.304989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.317794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:44.325384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:14:44.326808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 537/1035] 10.222.0.90 () {56 vars in 1141 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:44.333117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.342917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4d913-ccbd-4776-9fbd-bca3c1f28b24 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.347695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.348363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.348676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.348992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.352536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:44.352536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.352536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.361372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 499/1036] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:44.366862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.377801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0bfa-dc45-4c74-acfc-843976edea20 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.383022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.383796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.386725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.386725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.395413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.397318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.415960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:44.418452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 538/1037] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:44.423744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.434033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150989-255d-45b9-8f88-9aaca36d1ca8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.438989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.439718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.440093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.440470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.441807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:44.442184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.443844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.456622 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 500/1038] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:44.462696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.472697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a80b-9646-4f09-90bc-d02519ae8b75 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.477372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.478150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.478432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.478906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.485843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.488027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.627928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:44.634308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 539/1039] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:44.635902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.645719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599dac7-348c-44fa-81c9-0bfd7c61b00b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.650129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.650865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.651212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.651551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.652450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:44.652852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.654743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.676110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 501/1040] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:44.681816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.692620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd27ab-166e-4833-b269-1130c1c714f2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.697213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.697868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.698149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.698421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.706703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.708526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.721845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 540/1041] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:44.723437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.733004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929c3a5-a440-47d7-be50-8f0039ab34cb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.737599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.738960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.739312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.739650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.749617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.751763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.768548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:44.769827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 502/1042] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:44.775310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.784090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e1934-87ae-4928-8145-f7b92884e67d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.788619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.789263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.789545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.789819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.790530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:44.790831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.792473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.804678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 541/1043] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:44.810218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.820264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4ed9-64b7-45b9-af34-a19d9f93a111 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.824826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.825668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.826020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.826445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.833276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.835196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.847790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:44.849158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 503/1044] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:44.854605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.864888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa6b00-393d-4a1c-9f52-d03cf5817b73 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.869459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.870100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.870384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.870659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.871433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:44.871742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.873612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e59ab-0dc9-4964-9df1-50e21d7f97d5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.886684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 542/1045] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:44.892602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:44.902901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6881b-edca-484e-91f2-d80cb330299a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:44.907494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:44.908240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:44.908662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:44.909042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:44.910018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] RBAC: Adding query filter params (role.id=458a3aa0f1d94a38a19a6630c143bb06, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=8a526052e42248f3a38b329084dd262c) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:44.910429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:44.912348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f4c2-c80f-42ba-8f6a-b0293218c99c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:44.917900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 504/1046] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:44 2022] GET /identity/v3/role_assignments?user.id=8a526052e42248f3a38b329084dd262c&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=458a3aa0f1d94a38a19a6630c143bb06 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:45.849630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70397ca-cf59-4e2f-a700-f48a11ac59e6 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:45.850140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70397ca-cf59-4e2f-a700-f48a11ac59e6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:45.850218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70397ca-cf59-4e2f-a700-f48a11ac59e6 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:45.852072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 543/1047] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:45.857241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:45.857659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:45.857862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:45.874989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:45.876365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:45.884704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 505/1048] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:45.910205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70397ca-cf59-4e2f-a700-f48a11ac59e6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:45.922578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70397ca-cf59-4e2f-a700-f48a11ac59e6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:45.926963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05258e-c0ed-4788-8705-afd49466c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:45.927757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05258e-c0ed-4788-8705-afd49466c73b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:45.928042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05258e-c0ed-4788-8705-afd49466c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:45.928315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05258e-c0ed-4788-8705-afd49466c73b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:45.929534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05258e-c0ed-4788-8705-afd49466c73b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:45.931230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05258e-c0ed-4788-8705-afd49466c73b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:45.933103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 544/1049] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:45.938516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:45.948211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea355-c0e6-4bff-a055-443a5e837bb3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:45.952857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b29b6-aafe-4242-ac1c-49c8a8a50967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:45.953625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b29b6-aafe-4242-ac1c-49c8a8a50967 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:45.953908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b29b6-aafe-4242-ac1c-49c8a8a50967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:45.954180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b29b6-aafe-4242-ac1c-49c8a8a50967 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:45.954894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b29b6-aafe-4242-ac1c-49c8a8a50967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:45.956897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b29b6-aafe-4242-ac1c-49c8a8a50967 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:46.093160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 506/1050] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:14:45 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:14:46.546716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d3b88-b62b-4f28-9d78-69e507a3a4cc None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:46.547111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d3b88-b62b-4f28-9d78-69e507a3a4cc None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:46.547303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d3b88-b62b-4f28-9d78-69e507a3a4cc None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:46.549123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 545/1051] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:46.555530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:46.555960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:46.556367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:46.575326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:46.576525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:46.584180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 507/1052] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:46.607360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d3b88-b62b-4f28-9d78-69e507a3a4cc None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:46.623528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d3b88-b62b-4f28-9d78-69e507a3a4cc None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:46.628265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3c404-d488-4b4a-b963-b932a647ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:46.628946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c404-d488-4b4a-b963-b932a647ed97 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:46.629228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c404-d488-4b4a-b963-b932a647ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:46.629499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c404-d488-4b4a-b963-b932a647ed97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:46.637393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3c404-d488-4b4a-b963-b932a647ed97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:46.639135 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3c404-d488-4b4a-b963-b932a647ed97 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:46.647988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 546/1053] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:14:46.653881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:46.663064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a68e-abff-4485-8ab0-2b1b89de8e95 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:46.667466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1604a3-063d-42c1-8938-732884a42094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:46.668239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1604a3-063d-42c1-8938-732884a42094 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:46.668559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1604a3-063d-42c1-8938-732884a42094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:46.668831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1604a3-063d-42c1-8938-732884a42094 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:46.672588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1604a3-063d-42c1-8938-732884a42094 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:46.674281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1604a3-063d-42c1-8938-732884a42094 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:46.676651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 508/1054] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:47.187161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e0e6-5068-4f7d-b1c2-2780bd6159bb None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.187685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e0e6-5068-4f7d-b1c2-2780bd6159bb None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.187773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e0e6-5068-4f7d-b1c2-2780bd6159bb None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.189682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 547/1055] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:47.195503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.195905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.196049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.213654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:47.214810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:47.223004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 509/1056] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:47.245795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e0e6-5068-4f7d-b1c2-2780bd6159bb None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.258456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e0e6-5068-4f7d-b1c2-2780bd6159bb None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.262763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.263556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.263836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.264110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.275764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:47.283311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:14:47.284568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 548/1057] 10.222.0.90 () {56 vars in 1141 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:47.290534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.299517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93276ce-ef97-49ff-823f-3da6c74aded3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.303999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.304676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.304959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.305243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.305974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:47.306281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.307856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.315677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 510/1058] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:47.321661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.331493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc669-850e-4c9d-ad19-b5881b634577 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.336415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.337197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.337473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.337741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.347451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.349297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.365130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:47.370598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 549/1059] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:47.371756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.382031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c29fb4-35a4-4733-b9cf-516acb358028 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.386499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.387137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.387420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.387694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.388400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:47.388733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.390290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.402080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 511/1060] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:47.407440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.417310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af50ab-5036-42a1-adde-b37dc91c5041 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.421757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.422509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.422787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.423058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.430583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.432596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.445785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:47.446816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 550/1061] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:47.452253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.461555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28fb4-1cb8-4441-bf19-2c5ca2d1e672 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.465995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.466637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.466918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.467196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.468025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:47.468332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.470186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.487044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 512/1062] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:47.492839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.502315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606752c-16e1-444f-a847-ea174d5bfc54 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.506709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.507461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.507739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.508008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.517744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.519557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.535998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:47.541193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 551/1063] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:47.542286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.552107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270709-595a-4e61-ac47-9538e55d4314 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.556561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.557190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.557475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.557749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.558457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:47.558760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.560322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.572774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 513/1064] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:47.579807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.590368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fb8b9-f14e-4d9b-9e25-a4d981037d47 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.594896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.595679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.595959 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.596233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.603642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.605654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.618987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:47.620214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 552/1065] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:47.626143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.635571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221e07-4dbc-4a4d-a28d-d0672005010b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.639998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.640667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.640950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.641225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.642002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:47.642308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.644151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55984d-5d08-4948-bb97-8d28b2513878 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.656094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 514/1066] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:47.662269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:47.672452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465fd18-c4ca-4e06-9fbf-7ac602125d58 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:47.676914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5af1-55c3-40f9-b06a-437897288482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:47.677773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5af1-55c3-40f9-b06a-437897288482 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:47.678049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5af1-55c3-40f9-b06a-437897288482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:47.678316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5af1-55c3-40f9-b06a-437897288482 admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/8a526052e42248f3a38b329084dd262c/roles/458a3aa0f1d94a38a19a6630c143bb06` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:47.680504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d5af1-55c3-40f9-b06a-437897288482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=8a526052e42248f3a38b329084dd262c, role_id=458a3aa0f1d94a38a19a6630c143bb06)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:47.683147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d5af1-55c3-40f9-b06a-437897288482 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:47.743015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 553/1067] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:47 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/8a526052e42248f3a38b329084dd262c/roles/458a3aa0f1d94a38a19a6630c143bb06 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:14:48.451037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a96e-efd3-4421-8bcc-f52f43937130 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.451590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a96e-efd3-4421-8bcc-f52f43937130 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.451590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a96e-efd3-4421-8bcc-f52f43937130 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.453370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 515/1068] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:48.458574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.458953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.459255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.476390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:48.477604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:48.535696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 554/1069] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:48.559557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a96e-efd3-4421-8bcc-f52f43937130 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:48.571837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a96e-efd3-4421-8bcc-f52f43937130 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:48.576212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:48.576997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.577274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.577542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.588332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:48.595065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:48.596264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 516/1070] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:48.602416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:48.611662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e710c-d0f1-478a-b053-f04c5c5f15f2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:48.616960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:48.617625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.617908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.618185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.618936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:48.619243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:48.620888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:48.630372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 555/1071] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:48.636272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:48.646140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcbf98-e7fd-4d8b-8589-8392ceb242f1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:48.650503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:48.651331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.651607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.651878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] PATH_INFO: `/v3/users/5c9098c98f934ca1bcca8bb524660eea` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.664373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c9098c98f934ca1bcca8bb524660eea)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:48.666497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:48.668042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 517/1072] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:14:48 2022] GET /identity/v3/users/5c9098c98f934ca1bcca8bb524660eea => generated 285 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:48.673677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:48.683789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b29fec-4cdd-4430-9e45-5359559a0ff9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:48.688152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:48.688891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.689174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.689445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.697576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:48.699301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:48.712643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 556/1073] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:14:48.713801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:48.723319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d03c-90ee-4e65-9abf-7989b37c1e29 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:48.727905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb711-dfa4-4cc1-a58e-535d7bd5ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:48.728859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb711-dfa4-4cc1-a58e-535d7bd5ccfe admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.729146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb711-dfa4-4cc1-a58e-535d7bd5ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.729424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb711-dfa4-4cc1-a58e-535d7bd5ccfe admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.730599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deb711-dfa4-4cc1-a58e-535d7bd5ccfe admin admin] RBAC: Authorizing `identity:get_project(project_id=dd8d531bc7a145ed93ed1ee4daca764a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:48.732664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deb711-dfa4-4cc1-a58e-535d7bd5ccfe admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:48.734299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 518/1074] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:14:48 2022] GET /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:48.740661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:48.749405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541642-882f-4d8d-8098-72f627092455 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:48.754777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:48.755403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:48.755758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:48.756043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:48.756898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a, user.id=5c9098c98f934ca1bcca8bb524660eea) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:48.757212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:48.759051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac8f5-63ae-43bb-9ad8-5b91b8479a83 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:48.764347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 557/1075] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:48 2022] GET /identity/v3/role_assignments?user.id=5c9098c98f934ca1bcca8bb524660eea&scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:50.048683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145eeec-3ebb-455f-b63b-bd0511268910 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.049185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145eeec-3ebb-455f-b63b-bd0511268910 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.049185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145eeec-3ebb-455f-b63b-bd0511268910 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.050988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 519/1076] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:50.056101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.056524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.056692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.073897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:50.075082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:50.083283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 558/1077] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:50.107326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145eeec-3ebb-455f-b63b-bd0511268910 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.119721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145eeec-3ebb-455f-b63b-bd0511268910 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.124034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.124847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.125131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.125662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.136185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:50.143581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 01:14:50.144748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 520/1078] 10.222.0.90 () {56 vars in 1141 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:50.150601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.159327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace379bb-ab46-4b19-85b6-00c9a36a61d3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.163789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.164516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.164780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.165037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.165778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:50.166081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.167677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.180384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 559/1079] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:50.186859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.191993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f6fa6-67e7-4c93-8c73-168f3b983363 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.196673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.197435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.197717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.197990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.207953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.209789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.226172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:50.227332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 521/1080] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:50.233071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.243765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0173a-2740-47d6-aeab-58a440d92873 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.248347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.249075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.249360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.249636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.250627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:50.250933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.252568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.272824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 560/1081] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:50.278560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.288597 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93704b9c-15dc-4c9b-806c-9c058d29375a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.293072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.293844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.294129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.294405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.302267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.304210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.317600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 01:14:50.318728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 522/1082] 10.222.0.90 () {56 vars in 1114 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:50.324518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.334072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a3544-3921-40d1-b809-6cba63059381 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.338591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.339238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.339519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.339793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.340640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:50.340953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.342793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.361158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 561/1083] 10.222.0.90 () {56 vars in 1154 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:50.367318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.376947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d323a3-185e-447d-a31f-bef8a887858e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.381388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.382012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.382292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.382566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.390136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.391868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.400366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 523/1084] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:14:50.406062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.415998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd174b3-e4ec-4c84-9240-19f7bd7527e8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.420480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.421250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.421532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.421809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.432181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.434042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.450420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:14:50.451568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 562/1085] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:50.457183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.465855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79425-9ab7-476b-ba07-aa70472a15ed admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.470306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.470939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.471216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.471484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.472186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:50.473019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.474584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.485564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 524/1086] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:50.491560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.501386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d40-011e-4e29-afc6-7d1783d6fd40 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.505818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.506586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.506863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.507131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.513848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.515798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.528448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:14:50.529588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 563/1087] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:14:50.535781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.545329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0fb07-f83b-4941-aec5-c871cf5f6ccd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.549781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.551067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.551358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.551630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.552472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:50.552742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.554569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3360f-814f-409a-9191-56386c192a91 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.567108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 525/1088] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:50.572939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:50.583383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627402a-0c57-4b28-97b2-e6a6401a88d1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:50.587913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:50.588577 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:50.588858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:50.589131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:50.589950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] RBAC: Adding query filter params (role.id=458a3aa0f1d94a38a19a6630c143bb06, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=8a526052e42248f3a38b329084dd262c) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:50.590258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:50.592090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e93f2-d270-48cf-ad1d-d87da1a7b806 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:50.598331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 564/1089] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:50 2022] GET /identity/v3/role_assignments?user.id=8a526052e42248f3a38b329084dd262c&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=458a3aa0f1d94a38a19a6630c143bb06 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:51.024704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490b159-2ae2-4ee2-befd-ec673f4812c5 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.024991 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490b159-2ae2-4ee2-befd-ec673f4812c5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.025267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490b159-2ae2-4ee2-befd-ec673f4812c5 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.027070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 526/1090] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:51.032385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.032711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.032985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.050374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:51.051601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:51.059347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 565/1091] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:51.083806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490b159-2ae2-4ee2-befd-ec673f4812c5 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:51.096123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490b159-2ae2-4ee2-befd-ec673f4812c5 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:51.100896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:51.101705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.101977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.102246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.121442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:51.129175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:51.130375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 527/1092] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:51.136397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:51.145906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566309b3-f8ed-408c-8370-b32f4a881dce None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:51.150740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:51.151459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.151751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.152026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.152859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:51.153166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:51.154757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:51.163859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 566/1093] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:51.169774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:51.181218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87fb48-c2c5-40e8-8c0b-b2e5d9f4c050 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:51.185984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:51.186836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.187110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.187380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] PATH_INFO: `/v3/users/5c9098c98f934ca1bcca8bb524660eea` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.188606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c9098c98f934ca1bcca8bb524660eea)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:51.190880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:51.192986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 528/1094] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:14:51 2022] GET /identity/v3/users/5c9098c98f934ca1bcca8bb524660eea => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:51.198833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:51.209253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c6be9-f1d6-4ece-a70e-be9a20c17d38 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:51.213891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877493d-7d7e-48d3-ade5-d3d7c28bd5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:51.214729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877493d-7d7e-48d3-ade5-d3d7c28bd5fb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.215003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877493d-7d7e-48d3-ade5-d3d7c28bd5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.215267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877493d-7d7e-48d3-ade5-d3d7c28bd5fb admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.216451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877493d-7d7e-48d3-ade5-d3d7c28bd5fb admin admin] RBAC: Authorizing `identity:get_project(project_id=dd8d531bc7a145ed93ed1ee4daca764a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:51.218493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877493d-7d7e-48d3-ade5-d3d7c28bd5fb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:51.220249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 567/1095] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:14:51 2022] GET /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:51.226302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:51.357955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816aa2-82d3-48d6-8dc5-527929562083 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:51.362459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d69d-cd52-4412-9fbd-678ac8ba5adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:51.363850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d69d-cd52-4412-9fbd-678ac8ba5adc admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:51.364124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d69d-cd52-4412-9fbd-678ac8ba5adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:51.364390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d69d-cd52-4412-9fbd-678ac8ba5adc admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a/users/5c9098c98f934ca1bcca8bb524660eea/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:51.366327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d69d-cd52-4412-9fbd-678ac8ba5adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8d531bc7a145ed93ed1ee4daca764a, user_id=5c9098c98f934ca1bcca8bb524660eea, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:51.368962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d69d-cd52-4412-9fbd-678ac8ba5adc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:51.442315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 529/1096] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:14:51 2022] PUT /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a/users/5c9098c98f934ca1bcca8bb524660eea/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:14:53.676521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee421-9a47-4359-af02-20a169c38463 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.677008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee421-9a47-4359-af02-20a169c38463 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.677098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee421-9a47-4359-af02-20a169c38463 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.678838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 568/1097] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:53.684782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.685230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.685324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.703754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:53.704969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:53.759215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 530/1098] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:53.783008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee421-9a47-4359-af02-20a169c38463 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:53.794900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee421-9a47-4359-af02-20a169c38463 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:53.799186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:53.799953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.800754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.801038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.811452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:14:53.818973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:14:53.820100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 569/1099] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:14:53.825678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:53.834192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9bcbc-d442-40fe-b403-3b0ccf7dc7c6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:53.838581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:53.839215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.839491 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.839758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.840526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:53.840825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:53.842376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:53.850163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 531/1100] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:53.855418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:53.865225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7e7f-7f6a-4851-bf2c-52fcb65d84be admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:53.869698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:53.870468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.870746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.871018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] PATH_INFO: `/v3/users/5c9098c98f934ca1bcca8bb524660eea` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.872517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] RBAC: Authorizing `identity:get_user(user_id=5c9098c98f934ca1bcca8bb524660eea)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:53.874664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:53.876486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 570/1101] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:14:53 2022] GET /identity/v3/users/5c9098c98f934ca1bcca8bb524660eea => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:53.882123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:53.890981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e2d2-6252-4301-b3d8-4c5172229e28 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:53.895352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:53.895948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.896224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.896525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.903807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:53.905513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:53.913891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 532/1102] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:53.919007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:53.928668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3e7b8-5e81-4e62-8640-339a0276542b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:53.933087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58ea37-da86-42e3-aac9-27114f09408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:53.933882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58ea37-da86-42e3-aac9-27114f09408e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.934166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58ea37-da86-42e3-aac9-27114f09408e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.934442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58ea37-da86-42e3-aac9-27114f09408e admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.935581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58ea37-da86-42e3-aac9-27114f09408e admin admin] RBAC: Authorizing `identity:get_project(project_id=dd8d531bc7a145ed93ed1ee4daca764a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:53.937595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58ea37-da86-42e3-aac9-27114f09408e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:53.939187 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 571/1103] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:14:53 2022] GET /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:53.945136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:53.953439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931d3e6-9211-41b4-a9f9-644a81523aa3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:53.958229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:53.958837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:53.959120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:53.959392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:53.960198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a, user.id=5c9098c98f934ca1bcca8bb524660eea) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:53.960532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:53.962323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758576fa-dcd3-44cd-bbea-812786173bf3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:53.967867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 533/1104] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:53 2022] GET /identity/v3/role_assignments?user.id=5c9098c98f934ca1bcca8bb524660eea&scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:56.263737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506c278-6f27-47f0-b511-2080116daa8d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:56.264316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506c278-6f27-47f0-b511-2080116daa8d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:56.264316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506c278-6f27-47f0-b511-2080116daa8d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:56.266077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 572/1105] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:56.271248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:56.271662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:56.271795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:56.289445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:56.290612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:56.298053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 534/1106] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:14:56.323594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506c278-6f27-47f0-b511-2080116daa8d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:56.336036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506c278-6f27-47f0-b511-2080116daa8d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:56.340353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abeaa5-90d7-4c3d-a6be-209c0b321503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:56.341143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abeaa5-90d7-4c3d-a6be-209c0b321503 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:56.341426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abeaa5-90d7-4c3d-a6be-209c0b321503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:56.341701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abeaa5-90d7-4c3d-a6be-209c0b321503 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:56.342860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abeaa5-90d7-4c3d-a6be-209c0b321503 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:56.344573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abeaa5-90d7-4c3d-a6be-209c0b321503 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:56.346115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 573/1107] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:56.351222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:56.361662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f544be-63c1-461f-b14d-220c1b583730 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:56.366750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4185-a732-4ea3-83a4-55954c931071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:56.367399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4185-a732-4ea3-83a4-55954c931071 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:56.367679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4185-a732-4ea3-83a4-55954c931071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:56.367949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4185-a732-4ea3-83a4-55954c931071 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:56.368684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b4185-a732-4ea3-83a4-55954c931071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:56.370589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b4185-a732-4ea3-83a4-55954c931071 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:56.446986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 535/1108] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:14:56 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:14:58.743098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ee96-087e-4f28-8c4f-94ddb95b14c1 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.743638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ee96-087e-4f28-8c4f-94ddb95b14c1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.743638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ee96-087e-4f28-8c4f-94ddb95b14c1 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.745418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 574/1109] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:14:58.750934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.751353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.751484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.769710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:14:58.770930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:58.778443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 536/1110] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:14:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:14:58.801776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ee96-087e-4f28-8c4f-94ddb95b14c1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:58.813509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ee96-087e-4f28-8c4f-94ddb95b14c1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:58.818274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:58.819084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.819358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.819625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] PATH_INFO: `/v3/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.821083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] RBAC: Authorizing `identity:get_role(role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:58.822104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:58.822104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:14:58.822104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:14:58.822961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:58.824237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 575/1111] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:14:58 2022] GET /identity/v3/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:58.829388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:58.838646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0ee5-008d-4af8-8ef5-88752165a000 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:58.843134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:58.843976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.844259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.844574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] PATH_INFO: `/v3/users/724889caf4734497b055f426d96b8ffb` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.857464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] RBAC: Authorizing `identity:get_user(user_id=724889caf4734497b055f426d96b8ffb)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:58.859597 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:58.861319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 537/1112] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:14:58 2022] GET /identity/v3/users/724889caf4734497b055f426d96b8ffb => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:14:58.866913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:58.876192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152a079-dd02-4185-ab9c-4e2b95a05fcd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:58.881189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:58.881792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.882067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.882337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.889751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:58.891447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:58.899894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 576/1113] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:14:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:14:58.905047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:58.914103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9cd68-0728-45ef-a665-3b849d137e64 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:58.918502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5380-d862-4178-999f-2d20f6063143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:58.919305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5380-d862-4178-999f-2d20f6063143 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.919585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5380-d862-4178-999f-2d20f6063143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.919858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5380-d862-4178-999f-2d20f6063143 admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.921036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5380-d862-4178-999f-2d20f6063143 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd8d531bc7a145ed93ed1ee4daca764a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:58.923003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5380-d862-4178-999f-2d20f6063143 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:58.924612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 538/1114] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:14:58 2022] GET /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:14:58.930427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:58.938601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d129-5c41-4312-9525-d863206d0f3c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:58.943491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:58.944111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:58.944388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:58.944688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:58.945477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] RBAC: Adding query filter params (role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a, user.id=724889caf4734497b055f426d96b8ffb) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:14:58.945779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:58.947533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae997-8d23-444f-80cb-0f8e1841adbc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:58.952606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 577/1115] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:14:58 2022] GET /identity/v3/role_assignments?user.id=724889caf4734497b055f426d96b8ffb&scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:01.199895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebd30-143f-4db5-8809-42934f5ddc15 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:01.200546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebd30-143f-4db5-8809-42934f5ddc15 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:01.200546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebd30-143f-4db5-8809-42934f5ddc15 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:01.202195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 539/1116] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:01.208398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:01.208975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:01.209385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:01.229559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:01.231090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:01.238489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 578/1117] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:01.261662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ebd30-143f-4db5-8809-42934f5ddc15 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:01.273986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ebd30-143f-4db5-8809-42934f5ddc15 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:01.278275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:01.279095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:01.279372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:01.279642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] PATH_INFO: `/v3/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:01.281108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] RBAC: Authorizing `identity:get_role(role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:01.282107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:15:01.282107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:15:01.282107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:15:01.282973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:01.284289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 540/1118] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:01 2022] GET /identity/v3/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:01.290371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:01.299235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acea26-2abf-47fe-83ca-b01fcf3524e4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:01.303905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:01.304781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:01.305066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:01.305341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] PATH_INFO: `/v3/users/724889caf4734497b055f426d96b8ffb` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:01.306539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] RBAC: Authorizing `identity:get_user(user_id=724889caf4734497b055f426d96b8ffb)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:01.308732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:01.310292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 579/1119] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:01 2022] GET /identity/v3/users/724889caf4734497b055f426d96b8ffb => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:01.315723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:01.325200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec904e-52b7-4a37-87b7-5214619011a8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:01.329583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88db4e0-38d4-4a0c-9602-6af86a8ff83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:01.330446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88db4e0-38d4-4a0c-9602-6af86a8ff83a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:01.330726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88db4e0-38d4-4a0c-9602-6af86a8ff83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:01.330999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88db4e0-38d4-4a0c-9602-6af86a8ff83a admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:01.332686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88db4e0-38d4-4a0c-9602-6af86a8ff83a admin admin] RBAC: Authorizing `identity:get_project(project_id=dd8d531bc7a145ed93ed1ee4daca764a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:01.334679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88db4e0-38d4-4a0c-9602-6af86a8ff83a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:01.336264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 541/1120] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:01 2022] GET /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:01.341623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:01.351603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b91ba-b90f-47b7-9715-43c16c207170 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:01.356098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638acc-99cc-4b63-b1d0-a61f3455fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:01.356966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638acc-99cc-4b63-b1d0-a61f3455fd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:01.357245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638acc-99cc-4b63-b1d0-a61f3455fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:01.357553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638acc-99cc-4b63-b1d0-a61f3455fd0d admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a/users/724889caf4734497b055f426d96b8ffb/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:01.359719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638acc-99cc-4b63-b1d0-a61f3455fd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8d531bc7a145ed93ed1ee4daca764a, user_id=724889caf4734497b055f426d96b8ffb, role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:01.362404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638acc-99cc-4b63-b1d0-a61f3455fd0d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:01.468738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 580/1121] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:15:01 2022] PUT /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a/users/724889caf4734497b055f426d96b8ffb/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:15:03.694131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96b17d-1161-4d48-a64c-075374964d92 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.694657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96b17d-1161-4d48-a64c-075374964d92 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.694657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96b17d-1161-4d48-a64c-075374964d92 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.696453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 542/1122] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:03.701504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.701897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.702052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.719811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:03.721065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:03.782255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 581/1123] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:03.805796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96b17d-1161-4d48-a64c-075374964d92 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:03.818224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96b17d-1161-4d48-a64c-075374964d92 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:03.822507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:03.823339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.823617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.823890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] PATH_INFO: `/v3/roles/8c2f73cdac8b48239c75fa5f18d9334d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.825353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] RBAC: Authorizing `identity:get_role(role_id=8c2f73cdac8b48239c75fa5f18d9334d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:03.826923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:03.828212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 543/1124] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:03 2022] GET /identity/v3/roles/8c2f73cdac8b48239c75fa5f18d9334d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:03.834191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:03.842975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f97e2-4aa2-4f06-983a-01dba3ae621d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:03.847532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:03.848385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.848733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.849014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] PATH_INFO: `/v3/users/724889caf4734497b055f426d96b8ffb` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.850217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] RBAC: Authorizing `identity:get_user(user_id=724889caf4734497b055f426d96b8ffb)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:03.852350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:03.853949 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 582/1125] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:03 2022] GET /identity/v3/users/724889caf4734497b055f426d96b8ffb => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:03.859142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:03.868376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7693a-1d4c-4677-adf5-6b4028ba1d84 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:03.872787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:03.873392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.873670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.873939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.882146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:03.883845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:03.892245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 544/1126] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:15:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:03.898241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:03.907678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729864fa-6e4f-4ef7-92c8-38edc45e41be admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:03.912203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1da8-780d-405b-adc7-a56734e755e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:03.913047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1da8-780d-405b-adc7-a56734e755e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.913333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1da8-780d-405b-adc7-a56734e755e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.913611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1da8-780d-405b-adc7-a56734e755e1 admin admin] PATH_INFO: `/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.914760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec1da8-780d-405b-adc7-a56734e755e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd8d531bc7a145ed93ed1ee4daca764a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:03.916821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec1da8-780d-405b-adc7-a56734e755e1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:03.918501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 583/1127] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:03 2022] GET /identity/v3/projects/dd8d531bc7a145ed93ed1ee4daca764a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:03.924020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:03.932358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa03771-8437-4218-86a0-1727f3fc357d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:03.936852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:03.937461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:03.937739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:03.938011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:03.938812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] RBAC: Adding query filter params (role.id=8c2f73cdac8b48239c75fa5f18d9334d, scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a, user.id=724889caf4734497b055f426d96b8ffb) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:03.939117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:03.941487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d178e-be86-4a4b-94ca-ec0f265fa43b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:03.946955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 545/1128] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:15:03 2022] GET /identity/v3/role_assignments?user.id=724889caf4734497b055f426d96b8ffb&scope.project.id=dd8d531bc7a145ed93ed1ee4daca764a&role.id=8c2f73cdac8b48239c75fa5f18d9334d => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:06.290145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85a98-ea40-452f-a8cb-823f79e2bd9d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:06.290702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85a98-ea40-452f-a8cb-823f79e2bd9d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:06.290702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85a98-ea40-452f-a8cb-823f79e2bd9d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:06.292492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 584/1129] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:15:06.297590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:06.297988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:06.298148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:06.315218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:06.316995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:06.324694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 546/1130] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:15:06.348857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85a98-ea40-452f-a8cb-823f79e2bd9d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:06.360759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85a98-ea40-452f-a8cb-823f79e2bd9d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:06.365542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404125-01d9-4995-b199-c0359b4537c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:06.366310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404125-01d9-4995-b199-c0359b4537c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:06.366593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404125-01d9-4995-b199-c0359b4537c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:06.366869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404125-01d9-4995-b199-c0359b4537c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:06.368021 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9404125-01d9-4995-b199-c0359b4537c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:06.369727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9404125-01d9-4995-b199-c0359b4537c2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:06.371283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 585/1131] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:06.376929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:06.386223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1bdcc-1af2-4895-a214-2057c33259d3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:06.390733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04248e00-4b73-4276-ab47-3f966a5cca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:06.391398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04248e00-4b73-4276-ab47-3f966a5cca63 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:06.391684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04248e00-4b73-4276-ab47-3f966a5cca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:06.391960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04248e00-4b73-4276-ab47-3f966a5cca63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:06.392701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04248e00-4b73-4276-ab47-3f966a5cca63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:06.394577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04248e00-4b73-4276-ab47-3f966a5cca63 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:06.521840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 547/1132] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:15:06 2022] POST /identity/v3/projects => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:15:08.849416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e75a7-4fe6-49ab-b7e3-4004e1f8f635 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:08.849967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e75a7-4fe6-49ab-b7e3-4004e1f8f635 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:08.849967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e75a7-4fe6-49ab-b7e3-4004e1f8f635 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:08.851702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 586/1133] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:08.856891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:08.857290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:08.857448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:08.875353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:08.876772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:08.931448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 548/1134] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:08.956934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e75a7-4fe6-49ab-b7e3-4004e1f8f635 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:08.968745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e75a7-4fe6-49ab-b7e3-4004e1f8f635 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:08.973041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735fb8-02c8-4a98-a7a4-e3cf5f80b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:08.973800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735fb8-02c8-4a98-a7a4-e3cf5f80b5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:08.974075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735fb8-02c8-4a98-a7a4-e3cf5f80b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:08.974345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735fb8-02c8-4a98-a7a4-e3cf5f80b5b8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:08.975483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735fb8-02c8-4a98-a7a4-e3cf5f80b5b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:08.977183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735fb8-02c8-4a98-a7a4-e3cf5f80b5b8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:08.978716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 587/1135] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:15:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:08.984226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:08.993661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636207-4d9e-493f-9135-0059cbcb57c1 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:08.998165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32e66-be91-4223-9e76-d284f4540c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:08.998827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32e66-be91-4223-9e76-d284f4540c46 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:08.999113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32e66-be91-4223-9e76-d284f4540c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:08.999393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32e66-be91-4223-9e76-d284f4540c46 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:09.000111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32e66-be91-4223-9e76-d284f4540c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:09.002314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32e66-be91-4223-9e76-d284f4540c46 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:09.127126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 549/1136] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:15:08 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:15:11.467255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3a361-de0d-4da5-b704-9500c588d091 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.467809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3a361-de0d-4da5-b704-9500c588d091 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.467809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3a361-de0d-4da5-b704-9500c588d091 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.469604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 588/1137] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:11.474885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.475301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.475439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.492714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:11.493879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:11.501591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 550/1138] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:11.526151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3a361-de0d-4da5-b704-9500c588d091 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:11.538180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3a361-de0d-4da5-b704-9500c588d091 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:11.542574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:11.543340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.543625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.543904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.553734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:15:11.560659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:15:11.561798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 589/1139] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:11.568004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:11.576728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae242b-7728-4106-ab99-813b4732e1f4 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:11.581688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:11.582330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.582612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.582888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.583626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:11.583931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:11.585562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:11.593502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 551/1140] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:11.598775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:11.608745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1151a-85b1-4aff-a709-8a32c9b54c08 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:11.613761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:11.614606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.614892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.615169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] PATH_INFO: `/v3/users/9b51eb29e425492fae4e94f79f226377` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.628968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] RBAC: Authorizing `identity:get_user(user_id=9b51eb29e425492fae4e94f79f226377)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:11.631114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:11.632766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 590/1141] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:11 2022] GET /identity/v3/users/9b51eb29e425492fae4e94f79f226377 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:11.638439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:11.647770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b44a4-144e-475d-838b-b19d857f819a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:11.652107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:11.652767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.653047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.653317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.660705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:11.662430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:11.670870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 552/1142] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:15:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:11.677249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:11.686662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296525a-4c87-4913-9fd6-7461dc45859f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:11.691766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154b507-1468-4e70-970e-6b5b3ff74d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:11.692625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154b507-1468-4e70-970e-6b5b3ff74d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.692908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154b507-1468-4e70-970e-6b5b3ff74d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.693180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154b507-1468-4e70-970e-6b5b3ff74d60 admin admin] PATH_INFO: `/v3/projects/0c2325e9f18e48acb9d925b8673d39cc` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.694345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154b507-1468-4e70-970e-6b5b3ff74d60 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c2325e9f18e48acb9d925b8673d39cc)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:11.696389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154b507-1468-4e70-970e-6b5b3ff74d60 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:11.698043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 591/1143] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:11 2022] GET /identity/v3/projects/0c2325e9f18e48acb9d925b8673d39cc => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:11.703619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:11.712047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931f37f-6668-4862-9d3b-0eb9063caba2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:11.716486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:11.717108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:11.717436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:11.717654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:11.718462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=0c2325e9f18e48acb9d925b8673d39cc, user.id=9b51eb29e425492fae4e94f79f226377) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:11.718768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:11.720594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151f998-c1d4-4bc2-8a3d-b60fb0b72639 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:11.725696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 553/1144] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:15:11 2022] GET /identity/v3/role_assignments?user.id=9b51eb29e425492fae4e94f79f226377&scope.project.id=0c2325e9f18e48acb9d925b8673d39cc&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:13.970169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0c7c7-1862-42f1-acb4-4d33abaf372a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:13.970674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0c7c7-1862-42f1-acb4-4d33abaf372a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:13.970674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0c7c7-1862-42f1-acb4-4d33abaf372a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:13.972493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 592/1145] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:13.978131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:13.978541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:13.978677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:13.995642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:13.996839 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:14.004499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 554/1146] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:14.028058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0c7c7-1862-42f1-acb4-4d33abaf372a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:14.040435 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0c7c7-1862-42f1-acb4-4d33abaf372a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:14.044784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:14.045548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:14.045832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:14.046110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:14.056008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:15:14.062898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:15:14.064025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 593/1147] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:14.069461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:14.077939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405e7aa-cbfe-4a30-8e5e-bf5137d4e134 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:14.082870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:14.083501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:14.083776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:14.084047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:14.084813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:14.085117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:14.086678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:14.094527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 555/1148] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:14.100525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:14.110259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91152e-2aed-4fed-8892-769f0cd6b8e1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:14.114647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:14.115454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:14.115730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:14.115998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] PATH_INFO: `/v3/users/9b51eb29e425492fae4e94f79f226377` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:14.117233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] RBAC: Authorizing `identity:get_user(user_id=9b51eb29e425492fae4e94f79f226377)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:14.119336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:14.120906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 594/1149] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:14 2022] GET /identity/v3/users/9b51eb29e425492fae4e94f79f226377 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:14.126217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:14.135467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b42d-dfc8-4cfa-840d-7222d1622bd9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:14.139905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870c73-01fe-45d5-b8f7-ccccfe069dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:14.140765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870c73-01fe-45d5-b8f7-ccccfe069dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:14.141046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870c73-01fe-45d5-b8f7-ccccfe069dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:14.141315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870c73-01fe-45d5-b8f7-ccccfe069dc3 admin admin] PATH_INFO: `/v3/projects/0c2325e9f18e48acb9d925b8673d39cc` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:14.142479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6870c73-01fe-45d5-b8f7-ccccfe069dc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c2325e9f18e48acb9d925b8673d39cc)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:14.145033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6870c73-01fe-45d5-b8f7-ccccfe069dc3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:14.146625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 556/1150] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:14 2022] GET /identity/v3/projects/0c2325e9f18e48acb9d925b8673d39cc => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:14.153107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:14.163126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05d98e-280f-45bc-91ee-79bf921443eb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:14.167553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e97d0e-da76-4657-b966-bed4144a3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:14.168705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97d0e-da76-4657-b966-bed4144a3cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:14.168982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97d0e-da76-4657-b966-bed4144a3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:14.169249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97d0e-da76-4657-b966-bed4144a3cc1 admin admin] PATH_INFO: `/v3/projects/0c2325e9f18e48acb9d925b8673d39cc/users/9b51eb29e425492fae4e94f79f226377/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:14.171166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e97d0e-da76-4657-b966-bed4144a3cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2325e9f18e48acb9d925b8673d39cc, user_id=9b51eb29e425492fae4e94f79f226377, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:14.173819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e97d0e-da76-4657-b966-bed4144a3cc1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:14.303001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 595/1151] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:15:14 2022] PUT /identity/v3/projects/0c2325e9f18e48acb9d925b8673d39cc/users/9b51eb29e425492fae4e94f79f226377/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:15:16.562094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6ee6-11a8-48df-a3d6-0cb5bf3e1079 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.562641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6ee6-11a8-48df-a3d6-0cb5bf3e1079 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.562641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6ee6-11a8-48df-a3d6-0cb5bf3e1079 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.564387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 557/1152] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:16.569785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.570209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.570342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.587463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:16.588661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:16.643299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 596/1153] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:16.667267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f6ee6-11a8-48df-a3d6-0cb5bf3e1079 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:16.679823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f6ee6-11a8-48df-a3d6-0cb5bf3e1079 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:16.684119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:16.684925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.685208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.685483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.695314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:15:16.702123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:15:16.703261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 558/1154] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:16.708974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:16.717575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771fde-788d-4ac5-9bc7-e23617f19916 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:16.722499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:16.723136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.723414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.723686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.724448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:16.724751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:16.726324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:16.734196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 597/1155] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:15:16.740239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:16.749821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b849bbc-5b86-4ac1-b095-f1c3a5177c70 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:16.754535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:16.755346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.755628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.755901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] PATH_INFO: `/v3/users/9b51eb29e425492fae4e94f79f226377` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.757087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] RBAC: Authorizing `identity:get_user(user_id=9b51eb29e425492fae4e94f79f226377)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:16.759257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:16.760825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 559/1156] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:16 2022] GET /identity/v3/users/9b51eb29e425492fae4e94f79f226377 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:15:16.765939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:16.774900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85210017-5840-46f3-ae34-c47acb6d4ac9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:16.779283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:16.779880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.780159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.780449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.788286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:16.790002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:16.798429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 598/1157] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:15:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:16.804264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:16.813243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363bce-c558-417d-abeb-f05a10a8784d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:16.817566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbff1-94e0-4c83-820b-56e66e056b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:16.818350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbff1-94e0-4c83-820b-56e66e056b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.818630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbff1-94e0-4c83-820b-56e66e056b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.818905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbff1-94e0-4c83-820b-56e66e056b53 admin admin] PATH_INFO: `/v3/projects/0c2325e9f18e48acb9d925b8673d39cc` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.820037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbff1-94e0-4c83-820b-56e66e056b53 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c2325e9f18e48acb9d925b8673d39cc)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:16.822041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbff1-94e0-4c83-820b-56e66e056b53 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:16.823608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 560/1158] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:16 2022] GET /identity/v3/projects/0c2325e9f18e48acb9d925b8673d39cc => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:15:16.828862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:16.837028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d7a7e-1fbd-4e99-aa89-bf801431c3ae admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:16.841477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:16.842064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:16.842342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:16.842610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:16.843395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=0c2325e9f18e48acb9d925b8673d39cc, user.id=9b51eb29e425492fae4e94f79f226377) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:16.843698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:16.845500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c656cc-4d9b-48ee-8ad6-72637bc98549 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:16.851644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 599/1159] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:15:16 2022] GET /identity/v3/role_assignments?user.id=9b51eb29e425492fae4e94f79f226377&scope.project.id=0c2325e9f18e48acb9d925b8673d39cc&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:15:19.136356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62276c6-7fbe-413d-81c5-c3f2b774f1ed None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:19.136914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62276c6-7fbe-413d-81c5-c3f2b774f1ed None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:19.137020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62276c6-7fbe-413d-81c5-c3f2b774f1ed None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:19.138759 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 561/1160] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:19.144617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:19.145025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:19.145166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:19.162840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:19.163998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:19.171440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 600/1161] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:19.194760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62276c6-7fbe-413d-81c5-c3f2b774f1ed None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:19.207286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62276c6-7fbe-413d-81c5-c3f2b774f1ed None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:19.211622 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:19.212265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:19.212580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:19.212858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:19.221787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:19.224132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:19.233107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 562/1162] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:15:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:19.239194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:19.247968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23246-8adf-49ad-810a-3aef89776e42 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:19.252840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:19.254032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:19.254309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:19.254578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:19.261329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:19.263157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:19.277763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-eaa1dcc7-efc0-4b2f-b7a4-fa867bb7ed84 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 21 01:15:19.278871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 601/1163] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:15:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:19.285477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:19.294157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f37a-72e5-42d3-af7a-25e18844730d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:19.298748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:19.299386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:19.299670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:19.299947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:19.300698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:19.301005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:19.302592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd4d8-a49b-435b-a973-50992d12e916 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:19.309648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 563/1164] 10.222.0.90 () {56 vars in 1136 bytes} [Mon Feb 21 01:15:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:21.588998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430db1c-7eab-4662-892b-16c4fc5a1ed3 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:21.589568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430db1c-7eab-4662-892b-16c4fc5a1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:21.589568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430db1c-7eab-4662-892b-16c4fc5a1ed3 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:21.591307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 602/1165] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:21.596352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c9cc6-e83b-42cb-bccd-47057f441bcc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:21.596750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c9cc6-e83b-42cb-bccd-47057f441bcc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:21.596996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c9cc6-e83b-42cb-bccd-47057f441bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:21.615472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4b0c9cc6-e83b-42cb-bccd-47057f441bcc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:21.616680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4b0c9cc6-e83b-42cb-bccd-47057f441bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:21.624199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 564/1166] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:21.648002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430db1c-7eab-4662-892b-16c4fc5a1ed3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:21.659991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430db1c-7eab-4662-892b-16c4fc5a1ed3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:21.664295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:21.664963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:21.665246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:21.665521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:21.666269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:21.667273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:15:21.667273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:15:21.667273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:15:21.668146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee0492-4296-4ce6-871b-4f8e04c67a98 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:21.739181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 603/1167] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Feb 21 01:15:21 2022] POST /identity/v3/domains => generated 267 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:15:24.037058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31fdb1-80de-442d-9061-c7a3f4c8096c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:24.037561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31fdb1-80de-442d-9061-c7a3f4c8096c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:24.037561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31fdb1-80de-442d-9061-c7a3f4c8096c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:24.039337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 565/1168] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:24.044540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:24.044953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:24.045099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:24.062378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:24.063555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:24.117588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 604/1169] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:24.141521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31fdb1-80de-442d-9061-c7a3f4c8096c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:24.153915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31fdb1-80de-442d-9061-c7a3f4c8096c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:24.158133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95a843-2c67-49f0-91a9-90925d02503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:24.158959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95a843-2c67-49f0-91a9-90925d02503f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:24.159240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95a843-2c67-49f0-91a9-90925d02503f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:24.159510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95a843-2c67-49f0-91a9-90925d02503f admin admin] PATH_INFO: `/v3/domains/9f830d633b5742b6bb3058c5e387a3b0` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:24.169734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95a843-2c67-49f0-91a9-90925d02503f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=9f830d633b5742b6bb3058c5e387a3b0)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:24.171669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95a843-2c67-49f0-91a9-90925d02503f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:24.173252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 566/1170] 10.222.0.90 () {56 vars in 1204 bytes} [Mon Feb 21 01:15:24 2022] GET /identity/v3/domains/9f830d633b5742b6bb3058c5e387a3b0 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:24.178666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:24.187410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e70589-2a22-470b-b47f-73ebce9a1fd6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:24.192383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af500-2480-4814-9f1a-c9e3acf7a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:24.193046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af500-2480-4814-9f1a-c9e3acf7a452 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:24.193327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af500-2480-4814-9f1a-c9e3acf7a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:24.193602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af500-2480-4814-9f1a-c9e3acf7a452 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:24.194300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af500-2480-4814-9f1a-c9e3acf7a452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:24.196196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af500-2480-4814-9f1a-c9e3acf7a452 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:24.304289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 605/1171] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:15:24 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:15:26.600706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db112c-8d29-4821-9c5c-5fafc11db91e None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:26.601350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db112c-8d29-4821-9c5c-5fafc11db91e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:26.601350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db112c-8d29-4821-9c5c-5fafc11db91e None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:26.603011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 567/1172] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:26.608071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:26.608476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:26.608673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:26.626844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:26.628007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:26.681387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 606/1173] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:26.705877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db112c-8d29-4821-9c5c-5fafc11db91e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:26.718120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db112c-8d29-4821-9c5c-5fafc11db91e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:26.722960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ffee7-ae32-4896-90c3-95ce57287643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:26.723811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ffee7-ae32-4896-90c3-95ce57287643 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:26.724090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ffee7-ae32-4896-90c3-95ce57287643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:26.724362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ffee7-ae32-4896-90c3-95ce57287643 admin admin] PATH_INFO: `/v3/domains/9f830d633b5742b6bb3058c5e387a3b0` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:26.725558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ffee7-ae32-4896-90c3-95ce57287643 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=9f830d633b5742b6bb3058c5e387a3b0)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:26.727496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ffee7-ae32-4896-90c3-95ce57287643 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:26.729069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 568/1174] 10.222.0.90 () {56 vars in 1204 bytes} [Mon Feb 21 01:15:26 2022] GET /identity/v3/domains/9f830d633b5742b6bb3058c5e387a3b0 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:26.734345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:26.742933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5043-4a25-46a2-b57c-e08631e0412b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:26.747370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c244-8fa3-4fd1-bae9-4b502e4e3feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:26.748011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c244-8fa3-4fd1-bae9-4b502e4e3feb admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:26.748293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c244-8fa3-4fd1-bae9-4b502e4e3feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:26.748612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c244-8fa3-4fd1-bae9-4b502e4e3feb admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:26.749326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c244-8fa3-4fd1-bae9-4b502e4e3feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:26.751499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c244-8fa3-4fd1-bae9-4b502e4e3feb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:26.852268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 607/1175] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:15:26 2022] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:15:29.164371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3989-4b92-4dc6-be76-995c96e2bd13 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.164934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3989-4b92-4dc6-be76-995c96e2bd13 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.164934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3989-4b92-4dc6-be76-995c96e2bd13 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.166681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 569/1176] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:29.171824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.172208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.172384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.189646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:29.190849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:29.198423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 608/1177] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:29.222796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3989-4b92-4dc6-be76-995c96e2bd13 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:29.234735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3989-4b92-4dc6-be76-995c96e2bd13 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:29.239183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:29.239947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.240228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.240537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.251088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:15:29.258403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:15:29.259518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 570/1178] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:29.265034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:29.274289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5687b-d423-4ae3-b7a2-03e01cf9a8cd None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:29.278742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:29.279384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.279666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.279944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.280731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:29.281039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:29.282634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:29.290626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 609/1179] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:29.295784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:29.304916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bcc88-70d2-4d7a-84ec-e805f970d94c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:29.309305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:29.310109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.310384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.310650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] PATH_INFO: `/v3/users/a139ae9d975f48f48074234ee3a85713` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.324000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a139ae9d975f48f48074234ee3a85713)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:29.326128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:29.327674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 571/1180] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:29 2022] GET /identity/v3/users/a139ae9d975f48f48074234ee3a85713 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:29.333727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:29.343866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f97a-fa50-492b-b519-70c4607f5897 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:29.348364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:29.349025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.349337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.349583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.357189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:29.358929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:29.367507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 610/1181] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:15:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:29.372986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:29.382936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a898f-eca1-45d4-af4d-9de0bd8dc5f3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:29.387300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d6c7-8aca-4e12-b751-e0f2780b926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:29.388121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d6c7-8aca-4e12-b751-e0f2780b926e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.388397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d6c7-8aca-4e12-b751-e0f2780b926e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.388703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d6c7-8aca-4e12-b751-e0f2780b926e admin admin] PATH_INFO: `/v3/projects/6764328f216647be9e0db78c52ddf902` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.389856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443d6c7-8aca-4e12-b751-e0f2780b926e admin admin] RBAC: Authorizing `identity:get_project(project_id=6764328f216647be9e0db78c52ddf902)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:29.391850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443d6c7-8aca-4e12-b751-e0f2780b926e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:29.393528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 572/1182] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:29 2022] GET /identity/v3/projects/6764328f216647be9e0db78c52ddf902 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:29.399435 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:29.407736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f52f1a-d316-45aa-a30d-2f71d47e714e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:29.412292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:29.412935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:29.413213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:29.413485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:29.414284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=6764328f216647be9e0db78c52ddf902, user.id=a139ae9d975f48f48074234ee3a85713) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:29.414634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:29.416373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab44e9-c8c0-41ea-ae9a-4c2870b95aae admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:29.421502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 611/1183] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:15:29 2022] GET /identity/v3/role_assignments?user.id=a139ae9d975f48f48074234ee3a85713&scope.project.id=6764328f216647be9e0db78c52ddf902&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:31.693560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df6f3f-71f9-4048-8055-bcc3854da1ad None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.694093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df6f3f-71f9-4048-8055-bcc3854da1ad None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.694093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df6f3f-71f9-4048-8055-bcc3854da1ad None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.695834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 573/1184] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:31.700951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.701407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.701528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.718570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:31.719736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:31.727707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 612/1185] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:31.750566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df6f3f-71f9-4048-8055-bcc3854da1ad None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:31.762528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df6f3f-71f9-4048-8055-bcc3854da1ad None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:31.766726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:31.767472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.767750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.768025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.777721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:15:31.784917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:15:31.786012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 574/1186] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:15:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:31.791473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:31.800771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cddd6-ce3b-4b67-b18c-aa7e7ab19960 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:31.805410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:31.806060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.806345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.806624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.807370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:31.807678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:31.809315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:31.817492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 613/1187] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:15:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:31.822651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:31.832304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71997fe-2401-4ded-b6bb-3c9e8599bae1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:31.836795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:31.837606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.837889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.838161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] PATH_INFO: `/v3/users/a139ae9d975f48f48074234ee3a85713` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.839335 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] RBAC: Authorizing `identity:get_user(user_id=a139ae9d975f48f48074234ee3a85713)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:31.841480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:31.843006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 575/1188] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:31 2022] GET /identity/v3/users/a139ae9d975f48f48074234ee3a85713 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:31.848405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:31.857549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d2529-2899-4824-a9e7-08b62dc84f44 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:31.862034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e382309-ce45-4ad8-be2a-ab448d7e24c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:31.863513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e382309-ce45-4ad8-be2a-ab448d7e24c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.863800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e382309-ce45-4ad8-be2a-ab448d7e24c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.864078 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e382309-ce45-4ad8-be2a-ab448d7e24c4 admin admin] PATH_INFO: `/v3/projects/6764328f216647be9e0db78c52ddf902` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.865269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e382309-ce45-4ad8-be2a-ab448d7e24c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=6764328f216647be9e0db78c52ddf902)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:31.867315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e382309-ce45-4ad8-be2a-ab448d7e24c4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:31.869016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 614/1189] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:31 2022] GET /identity/v3/projects/6764328f216647be9e0db78c52ddf902 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:31.873937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:31.883159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a402d85-a48c-4ab3-9aab-14a47e9d7925 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:31.887595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb67d5-2bb6-46a1-8b92-b9f91f4636ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:31.888414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb67d5-2bb6-46a1-8b92-b9f91f4636ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:31.888728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb67d5-2bb6-46a1-8b92-b9f91f4636ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:31.889002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb67d5-2bb6-46a1-8b92-b9f91f4636ec admin admin] PATH_INFO: `/v3/projects/6764328f216647be9e0db78c52ddf902/users/a139ae9d975f48f48074234ee3a85713/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:31.890892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb67d5-2bb6-46a1-8b92-b9f91f4636ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764328f216647be9e0db78c52ddf902, user_id=a139ae9d975f48f48074234ee3a85713, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:31.894026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb67d5-2bb6-46a1-8b92-b9f91f4636ec admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:31.981851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 576/1190] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:15:31 2022] PUT /identity/v3/projects/6764328f216647be9e0db78c52ddf902/users/a139ae9d975f48f48074234ee3a85713/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:15:34.263247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2480d-d749-405e-bf92-73b4445a781a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.263795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2480d-d749-405e-bf92-73b4445a781a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.263795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2480d-d749-405e-bf92-73b4445a781a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.265597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 615/1191] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:15:34.270795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.271167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.271344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.288523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:15:34.289699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:34.347241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 577/1192] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:15:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:15:34.371109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2480d-d749-405e-bf92-73b4445a781a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:34.383689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2480d-d749-405e-bf92-73b4445a781a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:34.387989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:34.388856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.389140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.389415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.399227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:15:34.406085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:15:34.407200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 616/1193] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:15:34.412675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:34.421188 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfd939-b259-40e7-86bc-7f31a91dd8f6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:34.426079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:34.426723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.427001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.427274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.428007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:34.428309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:34.429919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:34.437826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 578/1194] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:34.443901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:34.453684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b248-8311-4046-b9ba-31a7d006c90e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:34.458145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:34.458966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.459245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.459548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] PATH_INFO: `/v3/users/a139ae9d975f48f48074234ee3a85713` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.460747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] RBAC: Authorizing `identity:get_user(user_id=a139ae9d975f48f48074234ee3a85713)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:34.462859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:34.464398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 617/1195] 10.222.0.90 () {56 vars in 1198 bytes} [Mon Feb 21 01:15:34 2022] GET /identity/v3/users/a139ae9d975f48f48074234ee3a85713 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:34.469608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:34.479101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198dcd7-436a-44fe-8492-6b6944f63b44 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:34.483507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:34.484110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.484390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.484694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.492702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:34.494401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:34.503153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 579/1196] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:15:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:34.508299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:34.517889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111940-bd55-4e4a-9415-77a1510b270c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:34.522296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b018-bf92-4e78-abf9-b36442ea85fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:34.523102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b018-bf92-4e78-abf9-b36442ea85fc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.523388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b018-bf92-4e78-abf9-b36442ea85fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.523668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b018-bf92-4e78-abf9-b36442ea85fc admin admin] PATH_INFO: `/v3/projects/6764328f216647be9e0db78c52ddf902` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.524841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b018-bf92-4e78-abf9-b36442ea85fc admin admin] RBAC: Authorizing `identity:get_project(project_id=6764328f216647be9e0db78c52ddf902)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:34.526851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b018-bf92-4e78-abf9-b36442ea85fc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:34.528603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 618/1197] 10.222.0.90 () {56 vars in 1207 bytes} [Mon Feb 21 01:15:34 2022] GET /identity/v3/projects/6764328f216647be9e0db78c52ddf902 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:15:34.533615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:34.542437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80cc43-44b4-421a-b28b-2727f8f73f0c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:34.546901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:34.547504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:34.547789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:34.548065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:34.548909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=6764328f216647be9e0db78c52ddf902, user.id=a139ae9d975f48f48074234ee3a85713) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:15:34.549219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:34.551625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e043696-bdf2-4d61-a516-32c8cd3f5cd7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:34.557172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 580/1198] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:15:34 2022] GET /identity/v3/role_assignments?user.id=a139ae9d975f48f48074234ee3a85713&scope.project.id=6764328f216647be9e0db78c52ddf902&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:16:51.939704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e9c0-ac0c-4ba9-a9b4-b3fc1c3afec0 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:51.940289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e9c0-ac0c-4ba9-a9b4-b3fc1c3afec0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:51.940289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e9c0-ac0c-4ba9-a9b4-b3fc1c3afec0 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:51.942831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 619/1199] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:16:51.949644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:51.950094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:51.950250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:51.970299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:16:51.971477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:16:51.979186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 581/1200] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:16:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:16:52.005810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e9c0-ac0c-4ba9-a9b4-b3fc1c3afec0 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:52.018139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e9c0-ac0c-4ba9-a9b4-b3fc1c3afec0 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:52.022714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:52.023494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:52.023771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:52.024041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:52.034347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:52.036177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:52.053248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:16:52.054401 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 620/1201] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:52.060359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:52.069701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb070-c744-4c76-9a69-2d1745cda181 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:52.074252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:52.074891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:52.075173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:52.075447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:52.076159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:52.076486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:52.078060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe4f63-3ff1-464d-9852-a2b1f536974a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:52.088955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 582/1202] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:52.094327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:52.104559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf57e7a-a5d6-48ca-830d-8fceccc8ba6d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:52.109322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7eb2d-fa71-43c5-8192-cd1d4e3993a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:52.109979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7eb2d-fa71-43c5-8192-cd1d4e3993a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:52.110252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7eb2d-fa71-43c5-8192-cd1d4e3993a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:52.110551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7eb2d-fa71-43c5-8192-cd1d4e3993a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:52.111253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7eb2d-fa71-43c5-8192-cd1d4e3993a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:52.113198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7eb2d-fa71-43c5-8192-cd1d4e3993a0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:52.211200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 621/1203] 10.222.0.90 () {60 vars in 1153 bytes} [Mon Feb 21 01:16:52 2022] POST /identity/v3/users => generated 251 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:16:54.602312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006dba-9a57-414c-9bb7-60ed9546c523 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.602905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006dba-9a57-414c-9bb7-60ed9546c523 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.602905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006dba-9a57-414c-9bb7-60ed9546c523 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.604654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 583/1204] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:16:54.609857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.610284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.610387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.630469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:16:54.631691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:16:54.639558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 622/1205] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:16:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:16:54.664204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006dba-9a57-414c-9bb7-60ed9546c523 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.676987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006dba-9a57-414c-9bb7-60ed9546c523 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.682271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.682271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.682595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.682875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.693528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:16:54.700580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:16:54.701808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 584/1206] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:54.707795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.716590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9359d-3c80-4e33-897e-639d67e596d6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.721057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.721697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.721973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.722242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.723473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:54.723803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.725411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.733375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 623/1207] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:54.739628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.748903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ed009-b7d5-4eef-9ef9-590786f95d63 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.753547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.754302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.754578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.754846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.764725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.766981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.782642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:16:54.783737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 585/1208] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:54.790099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.799475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c228-a436-4b4d-a08c-2ec3d1a61503 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.804666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.805301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.805578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.805848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.806550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:54.806851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.808417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.819598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 624/1209] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:54.825108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.834471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322acd-4b2e-4e51-ab0f-e36763f4f8aa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.839053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.839939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.840228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.840545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.848502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.850500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.864666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:16:54.865715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 586/1210] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:54.871309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.880899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5882-9a15-472d-9627-9e59f84548b7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.885568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.886316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.886603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.886880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.887712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:54.888019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.889941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.906998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 625/1211] 10.222.0.90 () {56 vars in 1164 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:54.912829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.922384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488ad3-8f68-4b82-87cd-11948a1979f6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.927702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.928333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.928690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.931765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.936707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.938483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.947278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 587/1212] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:16:54.952801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:54.962030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ba8e-91f0-447a-ac0f-b5a8748519c6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:54.966583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:54.967350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:54.967629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:54.967903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:54.978319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:54.980158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:54.997499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:16:55.006124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 626/1213] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:55.006239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:55.013016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31222adf-2ccb-4c99-82bb-b46d99d4689a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:55.017530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:55.018164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:55.018448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:55.018727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:55.019434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:55.020244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:55.021922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:55.032987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 588/1214] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:55.038798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:55.048933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04743e-569d-454a-8364-5ab1ba9c68cc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:55.053474 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:55.054264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:55.054538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:55.054803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:55.061453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:55.063386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:55.075917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:16:55.077062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 627/1215] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:16:55.083270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:55.092643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b0e9-8476-4610-aa1c-4ff287f9dc5a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:55.097177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:55.097813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:55.098699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:55.098974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:55.099745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:55.100052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:55.101922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bfc2a-0f45-40f0-8e89-62b65880d58a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:55.113555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 589/1216] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:16:55.119328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:55.129598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c168-587a-4ba8-a039-84ad5072bd57 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:55.133992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:55.134606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:55.134882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:55.135153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:55.135957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=3cfe1d2d99d34692a0706f569971bfa9) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:55.136260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:55.138119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef74e8-b2a8-402b-8b74-360336e9c9c8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:55.143235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 628/1217] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:16:55 2022] GET /identity/v3/role_assignments?user.id=3cfe1d2d99d34692a0706f569971bfa9&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:16:57.409774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f0b19-1ada-43cf-b977-850d798e6354 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.410352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f0b19-1ada-43cf-b977-850d798e6354 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.410352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f0b19-1ada-43cf-b977-850d798e6354 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.412093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 590/1218] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:16:57.417181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.418267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.418267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.435231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:16:57.436402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:16:57.444552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 629/1219] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:16:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:16:57.467301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f0b19-1ada-43cf-b977-850d798e6354 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.479433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f0b19-1ada-43cf-b977-850d798e6354 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.483797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.484605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.484889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.485161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.495700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:16:57.502895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:16:57.504052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 591/1220] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:57.510232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.518967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5292867-ca69-434d-9341-682f9f329dd3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.523436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.524087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.524369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.524674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.525416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:57.525720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.527304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.535142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 630/1221] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:57.540749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.551470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e740611-2281-4881-96cc-61e1a7ed0a0b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.555980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.559413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.559413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.559413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.568005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.569903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.587813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:16:57.589023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 592/1222] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:57.594753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.604346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df2f8-c872-4f27-9418-de689380a2a5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.608960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.609630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.609898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.610174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.610887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:57.611192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.612823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.625212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 631/1223] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:57.631710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.641175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76043a3d-2d60-4076-a073-d30ff0c785a9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.645626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.646396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.646671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.646941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.654020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.656004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.670269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:16:57.671375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 593/1224] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:57.677723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.687509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148c4c-0d1a-4840-b15b-db6361264b64 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.692836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.692836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.693062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.693277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.694102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:57.694413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.696264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.713009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 632/1225] 10.222.0.90 () {56 vars in 1164 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:57.718593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.728757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777ce0-912b-4618-8225-515acb6f567d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.733231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.733999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.735270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.735270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.745039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.746855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.763478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:16:57.764697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 594/1226] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:16:57.770145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.779735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071976b-dc5b-45a9-8217-4cdf475ef466 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.784532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.784905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.785183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.785968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.786713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:57.787015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.788621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.799609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 633/1227] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:57.805394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.814609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e433-11f2-47ed-a6e2-f6739fae01da admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.819071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.827586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.827586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.827586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.827586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.828850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.841291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:16:57.842383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 595/1228] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:16:57.848371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.859148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99438-a97c-4520-9a43-2c7901e237b1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.864524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.865174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.865458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.865734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.866514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:16:57.866826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.868785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cdf93-4ed3-4420-9bea-d8057b3adbab admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:57.880948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 634/1229] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:16:57.886537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:16:57.896637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be3c5-1850-411a-9668-eb8e92e20e5b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:16:57.901113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dc2b3-7b83-432e-9c2f-f995dbdcdf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:16:57.902096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc2b3-7b83-432e-9c2f-f995dbdcdf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:16:57.902372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc2b3-7b83-432e-9c2f-f995dbdcdf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:16:57.902647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc2b3-7b83-432e-9c2f-f995dbdcdf3c admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/3cfe1d2d99d34692a0706f569971bfa9/roles/b9d4fa09e8f3413bbb8c3495d8d217a5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:16:57.916993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dc2b3-7b83-432e-9c2f-f995dbdcdf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=3cfe1d2d99d34692a0706f569971bfa9, role_id=b9d4fa09e8f3413bbb8c3495d8d217a5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:16:57.919703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dc2b3-7b83-432e-9c2f-f995dbdcdf3c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:16:58.004701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 596/1230] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:16:57 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/3cfe1d2d99d34692a0706f569971bfa9/roles/b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:17:00.256061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4868-c693-4ad9-b75f-faaad3c2220f None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.256684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4868-c693-4ad9-b75f-faaad3c2220f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.256684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4868-c693-4ad9-b75f-faaad3c2220f None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.258395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 635/1231] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:00.263477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.263882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.264030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.281214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:00.282381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:00.337388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 597/1232] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:00.360537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4868-c693-4ad9-b75f-faaad3c2220f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.373452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4868-c693-4ad9-b75f-faaad3c2220f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.378132 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.381820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.381820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.381820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.390571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:17:00.397566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 01:17:00.398739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 636/1233] 10.222.0.90 () {56 vars in 1123 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:00.404772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.413483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a90b-cdb8-4c49-ac1c-8eedd87170f1 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.418009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.418654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.418934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.419206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.419941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:00.420242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.421853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.430173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 598/1234] 10.222.0.90 () {56 vars in 1124 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:00.439694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.449251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61dbd9-8256-4d81-bbe1-f7a7d1c82a61 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.453760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.454513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.454789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.455112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.465052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.466899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.482906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:00.485559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 637/1235] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:00.490219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.499604 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155b5f8-681b-4590-8e68-b747b4366435 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.504939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.505580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.508614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.508614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.508614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:00.508614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.508997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.520021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 599/1236] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:17:00.525685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.535247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93831fd3-8c26-44e4-9648-54264f4a6eeb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.539794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.540661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.540944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.541216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.548286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.550348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.564573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:17:00.565703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 638/1237] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:00.571820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.581209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76200d8-4a85-4895-9698-27aaca9a28d4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.585754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.586402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.586681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.586978 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.587793 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:00.588098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.589956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.606468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 600/1238] 10.222.0.90 () {56 vars in 1164 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:00.611781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.621967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dfae0-43f9-4d7b-8458-451439e84d68 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.626601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.627507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.627815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.628055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.636585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.638328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.646995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 639/1239] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:17:00.652647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.662532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e38d-6353-4317-bfae-8ae5ea07a91c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.666951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.667707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.667983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.668249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.678852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.680698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.696771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:00.697969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 601/1240] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:00.703627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.713083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c66ba-224d-45fd-b9bf-f724b858eda3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.717868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.718509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.718792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.719071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.719786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:00.720091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.721716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.733617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 640/1241] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:00.739733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.749093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f04e21-f530-4e58-82f6-8af8ac3052e5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.754095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.754866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.755141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.755410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.762171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.764087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.776697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:17:00.777882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 602/1242] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:17:00.783456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.793646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d55c-81a7-4997-821c-b5267c36b3a6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.798411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.799107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.799391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.799669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.800475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:00.803255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.803255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6e13-bafa-4fa6-80a4-63b72bfe1cd8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.815194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 641/1243] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:00.821054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:00.830987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554429e-03be-4931-a3b2-9ff2398f90fb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:00.835445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:00.836065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:00.836343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:00.836665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:00.837466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] RBAC: Adding query filter params (role.id=b9d4fa09e8f3413bbb8c3495d8d217a5, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=3cfe1d2d99d34692a0706f569971bfa9) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:00.837833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:00.839635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4245f44-2b78-4baa-a4a0-0172f87459fb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:00.845212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 603/1244] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:17:00 2022] GET /identity/v3/role_assignments?user.id=3cfe1d2d99d34692a0706f569971bfa9&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=b9d4fa09e8f3413bbb8c3495d8d217a5 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:03.180083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3751a-a840-4c47-b4f5-121f80845a2b None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.180635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3751a-a840-4c47-b4f5-121f80845a2b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.180729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3751a-a840-4c47-b4f5-121f80845a2b None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.182606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 642/1245] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:03.187951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.188392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.188558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.206054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:03.207783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:03.215402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 604/1246] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:03.239735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3751a-a840-4c47-b4f5-121f80845a2b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.251603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3751a-a840-4c47-b4f5-121f80845a2b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.256774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.257540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.257819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.258091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.267854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:17:03.274738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:17:03.275855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 643/1247] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:03.281561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.290293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe6b37-3636-4295-80b1-375a40cba889 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.294799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.295446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.295728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.296004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.296801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:03.297111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.298701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.307295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 605/1248] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:03.312709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.323167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a3418-0a9e-4a5c-aafb-a80c76d17a1d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.327604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.328350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.328660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.328932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.338837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.340696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.356864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:03.359431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 644/1249] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:03.363942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.373279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209c56-382e-4a04-93e8-69d565963310 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.378019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.378650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.379544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.379824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.380638 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:03.380949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.382523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.393742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 606/1250] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:03.399327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.408716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ef094-d3ea-402a-9578-1e7483b2201e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.413200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.413972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.414253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.414525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.421564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.423563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.437772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:17:03.438814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 645/1251] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:03.444933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.454130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086230fb-129b-472f-b97e-70a2d01edc1b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.458557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.459195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.459469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.459737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.460596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:03.460899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.462732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.479112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 607/1252] 10.222.0.90 () {56 vars in 1164 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:03.484378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.494212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388a1db-f3ec-46ac-9f4e-5a8c8c36032e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.498964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.499635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.504550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.504550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.508798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.510540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.519243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 646/1253] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:17:03.524570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.533910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dec29-7a89-4ed6-a3fe-1f2a8af2633d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.538328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.539087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.539364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.539637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.549484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.551825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.569367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:03.570471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 608/1254] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:03.576226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.584881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662e16c-21e2-45b0-bdef-9d31ffc10743 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.589388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.590027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.590311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.590588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.591304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:03.591611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.593217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.604095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 647/1255] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:03.609484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.619422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46c18-d248-490e-b165-796803489f49 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.623906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.624717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.624998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.625268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.632675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.634610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.647182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:17:03.649409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 609/1256] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:17:03.654227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.664129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76daaa-51fb-4260-9d26-8863849e134e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.668663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.669306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.669590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.669867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.670645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:03.670991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.672839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e6b14-722a-40d0-957d-6c9b013ae317 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.686265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 648/1257] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:03.692492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:03.702622 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a31ae-0d5a-460d-bb4a-09b2004845f8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:03.707100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:03.707725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:03.708006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:03.708277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:03.709127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=3cfe1d2d99d34692a0706f569971bfa9) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:03.709434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:03.711255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f567f-a217-4869-8d44-5a682b7d876a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:03.716666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 610/1258] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:17:03 2022] GET /identity/v3/role_assignments?user.id=3cfe1d2d99d34692a0706f569971bfa9&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=2b566b9d44514140984818f0428be699 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:05.974680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864658c-938c-4f1a-ac20-51a3a1743548 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:05.975196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864658c-938c-4f1a-ac20-51a3a1743548 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:05.975196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864658c-938c-4f1a-ac20-51a3a1743548 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:05.976963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 649/1259] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:05.982126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:05.986805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:05.986805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.000093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:06.001297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:06.009748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 611/1260] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:06.033058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864658c-938c-4f1a-ac20-51a3a1743548 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.045183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864658c-938c-4f1a-ac20-51a3a1743548 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.049530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.050302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.050584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.050863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.060878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:17:06.068278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:17:06.069719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 650/1261] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:06.076090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.086365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7427b-60c0-42f3-ac20-c56f80efc3fa None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.091110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.091769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.092063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.092338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.093141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:06.093423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.095088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.104636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 612/1262] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:06.110503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.120636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da751-8a2c-49f9-ab1b-bbbf9273f61e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.125246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.130284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.130284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.130284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.137954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.139786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.156593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:06.157778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 651/1263] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:06.163544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.173115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c6bf8-6b81-4cde-afa9-aec0d3185b8d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.177664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.178296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.178574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.178846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.179601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:06.179901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.181611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.193446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 613/1264] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:06.198892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.209029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf158c8-4870-4657-97a3-179e59244de3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.213509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.214271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.214548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.214820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.222566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.224575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.237967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:17:06.239502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 652/1265] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:06.244980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.255153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c022b4-086b-42ab-8960-a433275c073e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.259642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.260275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.260631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.260906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.261720 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:06.262024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.263835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.280555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 614/1266] 10.222.0.90 () {56 vars in 1164 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:06.285701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.295139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e091b4-6866-44e7-b5bc-d65846006c9c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.299680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.300452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.301290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.301556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.311939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.313809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.330365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:06.331509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 653/1267] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:06.337066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.346449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c133f-8c1d-449e-a06f-bc8888c8b345 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.350938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.351575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.351857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.352133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.352882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:06.353185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.354760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.366483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 615/1268] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:06.371567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.381731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504da06-be3b-4a00-9255-534a1e260539 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.386138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.386879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.387158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.387432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.394017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.395957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.409409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:17:06.410759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 654/1269] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 01:17:06.416687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.433454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abf71-1e84-431a-af50-2adfa26413cf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.438649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.439752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.440253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.440799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.442928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:06.443473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.446968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2002e-56ec-4b4d-b53b-6c76e84e8f58 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.462131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 616/1270] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:06.468308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:06.478016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e709bd-abe0-42f0-b5fb-3686c1b99db5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:06.482609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687ade-ffb4-4440-bae3-469da7c64588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:06.483508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687ade-ffb4-4440-bae3-469da7c64588 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:06.483792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687ade-ffb4-4440-bae3-469da7c64588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:06.484070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687ade-ffb4-4440-bae3-469da7c64588 admin admin] PATH_INFO: `/v3/projects/75be4377b0234a698fd3c197146c7946/users/3cfe1d2d99d34692a0706f569971bfa9/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:06.486082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687ade-ffb4-4440-bae3-469da7c64588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be4377b0234a698fd3c197146c7946, user_id=3cfe1d2d99d34692a0706f569971bfa9, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:06.491305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687ade-ffb4-4440-bae3-469da7c64588 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:06.576053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 655/1271] 10.222.0.90 () {58 vars in 1460 bytes} [Mon Feb 21 01:17:06 2022] PUT /identity/v3/projects/75be4377b0234a698fd3c197146c7946/users/3cfe1d2d99d34692a0706f569971bfa9/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:17:08.841791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac9eb-ce05-48fa-887f-d79c2ebe1675 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:08.842311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac9eb-ce05-48fa-887f-d79c2ebe1675 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:08.842423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac9eb-ce05-48fa-887f-d79c2ebe1675 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:08.844118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 617/1272] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:08.849726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:08.850112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:08.850276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:08.867530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:08.868662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:08.923549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 656/1273] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:08.947723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac9eb-ce05-48fa-887f-d79c2ebe1675 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:08.960341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac9eb-ce05-48fa-887f-d79c2ebe1675 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:08.964972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:08.965794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:08.966073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:08.966343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:08.976206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 01:17:08.982950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 01:17:08.984121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 618/1274] 10.222.0.90 () {56 vars in 1117 bytes} [Mon Feb 21 01:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:08.989802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:08.998592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def0f97-16a9-4beb-ada8-a7d72d4a2085 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.003442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.004626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.004907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.005177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.005922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:09.006226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.007820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.015829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 657/1275] 10.222.0.90 () {56 vars in 1120 bytes} [Mon Feb 21 01:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:09.021680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.031296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9cc9-1b05-4c86-8944-808fd1cf3612 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.035973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.036745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.037023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.037292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.047057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.048918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.064874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:09.066002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 619/1276] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:09.072251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.082572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f314fb-e921-4be0-b71b-9517a1ad0b00 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.087149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.087784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.088065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.088374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.089162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:09.089477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.091054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.102426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 658/1277] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:09.107586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.117014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe0033-e5b2-4587-b4bc-a72bd22e1869 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.121618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.122337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.122618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.122893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.130867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.132906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.147200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 01:17:09.148313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 620/1278] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:09.153763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.163656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ab70e-7dca-4c2d-9cdb-c90979262b73 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.168877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.168877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.169122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.169399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.170223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:09.170527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.172348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.188974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 659/1279] 10.222.0.90 () {56 vars in 1164 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:09.195101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.204525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6421-8bc5-418f-8725-81b87ba6d700 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.209608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.210239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.210525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.210799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.219951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.221724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.230590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 621/1280] 10.222.0.90 () {58 vars in 1324 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:17:09.235950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.246059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8acd82-81e0-4de2-8328-e7443be983f7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.250506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.254692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.254692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.254692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.262905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.264772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.281068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 01:17:09.282214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 660/1281] 10.222.0.90 () {56 vars in 1129 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:09.287900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.296534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fff3e-6dda-40c4-93df-8a66bac675eb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.301060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.302210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.302493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.302770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.303480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:09.303786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.305393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.316254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 622/1282] 10.222.0.90 () {56 vars in 1130 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:09.322111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.331586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15b51f-b06b-4166-a914-b6e78854ae82 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.335948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.336782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.337066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.337337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.343974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.345930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.358590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING keystone.server.flask.application [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 01:17:09.359683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 661/1283] 10.222.0.90 () {56 vars in 1132 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:09.365222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.375026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b2a6-634a-4d74-a8c7-efc0f3f03a21 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.379709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.380339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.380655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.380936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.382310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:09.382619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.384456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c14f-460c-41bd-880e-a0767d9fbd4a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.396110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 623/1284] 10.222.0.90 () {56 vars in 1169 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:09.401706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:09.411793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d4620-c5d5-45ee-87e5-fdd38b58cefe admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:09.416269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:09.416928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:09.417213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:09.417491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:09.418301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] RBAC: Adding query filter params (role.id=2b566b9d44514140984818f0428be699, scope.project.id=75be4377b0234a698fd3c197146c7946, user.id=3cfe1d2d99d34692a0706f569971bfa9) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:09.418613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:09.420462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebaed8-9a5d-4c46-9fc2-ae2a909f3f1d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:09.426085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 662/1285] 10.222.0.90 () {56 vars in 1395 bytes} [Mon Feb 21 01:17:09 2022] GET /identity/v3/role_assignments?user.id=3cfe1d2d99d34692a0706f569971bfa9&scope.project.id=75be4377b0234a698fd3c197146c7946&role.id=2b566b9d44514140984818f0428be699 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:11.722192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7742f-4530-4b2e-bb33-dbfaf6511b12 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:11.722718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7742f-4530-4b2e-bb33-dbfaf6511b12 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:11.722811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7742f-4530-4b2e-bb33-dbfaf6511b12 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:11.724548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 624/1286] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:17:11.730179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:11.730555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:11.730724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:11.747649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:11.753005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:11.756640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 663/1287] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:17:11.779674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7742f-4530-4b2e-bb33-dbfaf6511b12 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:11.792214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7742f-4530-4b2e-bb33-dbfaf6511b12 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:11.796589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:11.797357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:11.797650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:11.797919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:11.798562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:11.800130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:11.811018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 01:17:11.812176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 625/1288] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:17:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:11.817829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:11.827386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c8f21-8fb5-4f5c-9a41-d586b46d671d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:11.831869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:11.832580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:11.832866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:11.833142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:11.833845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:11.834747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:11.836339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af570e-b356-4f54-9196-5cbb113cdd1d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:11.841284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 664/1289] 10.222.0.90 () {56 vars in 1137 bytes} [Mon Feb 21 01:17:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:11.846432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:11.855652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c8951-635d-40b6-8a72-7505c5aec321 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:11.860058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:11.860782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:11.861063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:11.861336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] PATH_INFO: `/v3/services` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:11.862019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:11.862320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:11.863863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35378c96-2977-4e37-abd9-cfb2fa52d3e7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:11.868095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 626/1290] 10.222.0.90 () {56 vars in 1137 bytes} [Mon Feb 21 01:17:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:14.121692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab84-e578-45f1-95b1-97805002d77e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:14.122207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab84-e578-45f1-95b1-97805002d77e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:14.122386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab84-e578-45f1-95b1-97805002d77e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:14.124125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 665/1291] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:14.129686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470bec-8b28-4066-898f-e7abb21f4dac None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:14.131982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470bec-8b28-4066-898f-e7abb21f4dac None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:14.131982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470bec-8b28-4066-898f-e7abb21f4dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:14.149247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e1470bec-8b28-4066-898f-e7abb21f4dac None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:14.150441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e1470bec-8b28-4066-898f-e7abb21f4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:14.158101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 627/1292] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:14.182819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cab84-e578-45f1-95b1-97805002d77e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:14.195475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cab84-e578-45f1-95b1-97805002d77e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:14.199825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd235005-ad51-411c-9518-7829ccb459a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:14.200494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235005-ad51-411c-9518-7829ccb459a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:14.200779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235005-ad51-411c-9518-7829ccb459a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:14.201052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235005-ad51-411c-9518-7829ccb459a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:14.201764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235005-ad51-411c-9518-7829ccb459a0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:14.203349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235005-ad51-411c-9518-7829ccb459a0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:14.353784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 666/1293] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Feb 21 01:17:14 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:17:16.614749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cc22c-a71d-4f18-bc63-a286d4c721fb None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:16.615309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cc22c-a71d-4f18-bc63-a286d4c721fb None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:16.615429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cc22c-a71d-4f18-bc63-a286d4c721fb None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:16.617699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 628/1294] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:16.623121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:16.623501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:16.626065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:16.641395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:16.642571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:16.658839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 667/1295] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:16.683078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cc22c-a71d-4f18-bc63-a286d4c721fb None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:16.695022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cc22c-a71d-4f18-bc63-a286d4c721fb None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:16.699236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:16.700003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:16.700282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:16.700611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:16.701262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:16.702829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:16.714045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 01:17:16.715140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 629/1296] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:17:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:16.720846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:16.730332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe91df-e765-4455-99ee-90cb5cb11fc2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:16.734841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:16.735491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:16.735769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:16.736047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:16.736790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:16.737097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:16.738735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:16.743803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 668/1297] 10.222.0.90 () {56 vars in 1137 bytes} [Mon Feb 21 01:17:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:16.749591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:16.759146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee83cf-e8b4-4050-8ed7-d7af334d615b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:16.763591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:16.764216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:16.764531 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:16.764807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:16.765578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] RBAC: Adding query filter params (interface=public, service_id=9334602f506b43edb77be3634f63f557, region_id=RegionOne) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:16.765886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:16.767456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1797ce-9ba9-4da1-8792-e9370327f9cd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:16.772796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 630/1298] 10.222.0.90 () {56 vars in 1272 bytes} [Mon Feb 21 01:17:16 2022] GET /identity/v3/endpoints?service_id=9334602f506b43edb77be3634f63f557&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:17:16.778004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:16.787849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed30a22-0a4d-4b65-9568-8b4c6d9785d0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:16.792329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aecc65-f144-47fb-a582-a9faf36829d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:16.795471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aecc65-f144-47fb-a582-a9faf36829d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:16.795471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aecc65-f144-47fb-a582-a9faf36829d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:16.795471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aecc65-f144-47fb-a582-a9faf36829d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:16.795471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aecc65-f144-47fb-a582-a9faf36829d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:16.795788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aecc65-f144-47fb-a582-a9faf36829d4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:16.802245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 669/1299] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:17:16 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:17:19.091390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3a05-482b-4572-9c2e-1183d2e192b4 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:19.091891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3a05-482b-4572-9c2e-1183d2e192b4 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:19.091891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3a05-482b-4572-9c2e-1183d2e192b4 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:19.093659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 631/1300] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:17:19.098888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:19.099286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:19.106206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:19.118027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:17:19.119201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:19.126899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 670/1301] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:17:19.150341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3a05-482b-4572-9c2e-1183d2e192b4 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:19.163979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3a05-482b-4572-9c2e-1183d2e192b4 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:19.168619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:19.169450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:19.169732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:19.170006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:19.170656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:19.172235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:19.183575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING keystone.server.flask.application [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 01:17:19.184757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 632/1302] 10.222.0.90 () {56 vars in 1138 bytes} [Mon Feb 21 01:17:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 01:17:19.190810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:19.199816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0f5c-abfc-4f16-948c-d24312e3a4c9 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:19.204567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:19.205211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:19.205494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:19.205769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] PATH_INFO: `/v3/services` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:19.206470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:17:19.206776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:19.208364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6164ed-7056-45ff-8b1f-231c9b0f9757 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:19.213963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 671/1303] 10.222.0.90 () {56 vars in 1137 bytes} [Mon Feb 21 01:17:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:17:19.219202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:19.229647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bedbe-ea24-43fa-97fd-ca4b02014456 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:19.234253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246045d0-812f-4ea1-8dfa-5eeb5288d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:19.234871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246045d0-812f-4ea1-8dfa-5eeb5288d854 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:19.235156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246045d0-812f-4ea1-8dfa-5eeb5288d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:19.236447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246045d0-812f-4ea1-8dfa-5eeb5288d854 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:19.236447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246045d0-812f-4ea1-8dfa-5eeb5288d854 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:19.237811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246045d0-812f-4ea1-8dfa-5eeb5288d854 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:19.341752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 633/1304] 10.222.0.90 () {60 vars in 1165 bytes} [Mon Feb 21 01:17:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:23:37.202300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce558-a84b-4b1f-90e1-590061cf033d None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:37.202750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce558-a84b-4b1f-90e1-590061cf033d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:37.202843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce558-a84b-4b1f-90e1-590061cf033d None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:37.211706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca650c4-b436-49e8-b4b0-ee2066ab592d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:37.213355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca650c4-b436-49e8-b4b0-ee2066ab592d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:37.214025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca650c4-b436-49e8-b4b0-ee2066ab592d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:37.217495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 672/1305] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:37.325979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-dca650c4-b436-49e8-b4b0-ee2066ab592d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:37.327152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-dca650c4-b436-49e8-b4b0-ee2066ab592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:37.440770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 634/1306] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:37.450720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce558-a84b-4b1f-90e1-590061cf033d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:37.452852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-835ce558-a84b-4b1f-90e1-590061cf033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:37.641985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce558-a84b-4b1f-90e1-590061cf033d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:37.740724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71298421-a5f2-4df6-9db7-e8e29cf87a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:37.741315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71298421-a5f2-4df6-9db7-e8e29cf87a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:37.741600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71298421-a5f2-4df6-9db7-e8e29cf87a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:37.741877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71298421-a5f2-4df6-9db7-e8e29cf87a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:37.742672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71298421-a5f2-4df6-9db7-e8e29cf87a8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:37.744620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71298421-a5f2-4df6-9db7-e8e29cf87a8d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:37.773045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 673/1307] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:23:37 2022] GET /identity/v3/projects => generated 2553 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:23:40.156910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d9aff-3e93-4c4f-9785-6e02a732a225 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:40.157806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d9aff-3e93-4c4f-9785-6e02a732a225 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:40.158088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d9aff-3e93-4c4f-9785-6e02a732a225 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:40.159865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 635/1308] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:40.164968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb67f-79ed-448b-abd1-3a6504cae45e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:40.165392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb67f-79ed-448b-abd1-3a6504cae45e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:40.165518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb67f-79ed-448b-abd1-3a6504cae45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:40.235771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-95ffb67f-79ed-448b-abd1-3a6504cae45e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:40.236915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-95ffb67f-79ed-448b-abd1-3a6504cae45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:40.340634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 674/1309] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:40.389012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295581e-0661-4dd6-bb5f-905e8420392f None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:40.389635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295581e-0661-4dd6-bb5f-905e8420392f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:40.389913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295581e-0661-4dd6-bb5f-905e8420392f None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:40.391755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 636/1310] 10.222.0.90 () {54 vars in 964 bytes} [Mon Feb 21 01:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:40.398325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35153d0-d950-45c1-a824-827c3b83c388 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:40.398613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35153d0-d950-45c1-a824-827c3b83c388 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:40.398885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35153d0-d950-45c1-a824-827c3b83c388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:40.490931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c35153d0-d950-45c1-a824-827c3b83c388 None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:40.492457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c35153d0-d950-45c1-a824-827c3b83c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:40.576217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 675/1311] 10.222.0.90 () {58 vars in 1061 bytes} [Mon Feb 21 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:40.585212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295581e-0661-4dd6-bb5f-905e8420392f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:40.586715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7295581e-0661-4dd6-bb5f-905e8420392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:40.697722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295581e-0661-4dd6-bb5f-905e8420392f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:40.778653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:40.779226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:40.779504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:40.779774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:40.781534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:40.904655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:40.906433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0a2e1-99a1-4259-9d28-65343b7bc8da service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:40.925339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 637/1312] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:23:43.597384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553c69-53f4-4357-be15-5a0d6a3399a9 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:43.597909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553c69-53f4-4357-be15-5a0d6a3399a9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:43.597909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553c69-53f4-4357-be15-5a0d6a3399a9 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:43.599592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 676/1313] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:43.605450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7624-0cc0-4248-a5e5-9fbdd304735e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:43.605912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7624-0cc0-4248-a5e5-9fbdd304735e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:43.606077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7624-0cc0-4248-a5e5-9fbdd304735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:43.675365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-85ef7624-0cc0-4248-a5e5-9fbdd304735e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:43.676572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-85ef7624-0cc0-4248-a5e5-9fbdd304735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:43.766819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 638/1314] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:43.805117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553c69-53f4-4357-be15-5a0d6a3399a9 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:43.806657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bb553c69-53f4-4357-be15-5a0d6a3399a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:43.905446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553c69-53f4-4357-be15-5a0d6a3399a9 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:43.972890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:43.973523 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:43.973803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:43.974075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:43.975677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:44.078178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:44.079618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fcb9-d598-49ae-be91-28da636fe0de service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:44.097194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 677/1315] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:23:46.819021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6a319-3268-4eec-9e92-f47e7a92531d None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:46.819541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6a319-3268-4eec-9e92-f47e7a92531d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:46.819541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6a319-3268-4eec-9e92-f47e7a92531d None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:46.821338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 639/1316] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:46.827227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6852d-ae67-42b4-995a-3bd77c2f5ab4 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:46.827668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6852d-ae67-42b4-995a-3bd77c2f5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:46.827813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6852d-ae67-42b4-995a-3bd77c2f5ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:46.890664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-28f6852d-ae67-42b4-995a-3bd77c2f5ab4 None None] MFA Rules not processed for user `8e0324dddc2245d1a18abd9fe6173b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:46.891790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-28f6852d-ae67-42b4-995a-3bd77c2f5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:46.985113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 678/1317] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:47.041774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639dcdc-94ed-4237-b665-407c781280fe None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:47.042055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639dcdc-94ed-4237-b665-407c781280fe None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:47.042329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639dcdc-94ed-4237-b665-407c781280fe None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:47.044088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 640/1318] 10.222.0.90 () {54 vars in 964 bytes} [Mon Feb 21 01:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:47.050007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e4b4-978a-4379-9b1d-f189a78be257 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:47.050311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e4b4-978a-4379-9b1d-f189a78be257 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:47.050589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e4b4-978a-4379-9b1d-f189a78be257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:47.121123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-eb50e4b4-978a-4379-9b1d-f189a78be257 None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:47.122357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eb50e4b4-978a-4379-9b1d-f189a78be257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:47.194990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 679/1319] 10.222.0.90 () {58 vars in 1061 bytes} [Mon Feb 21 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:47.203899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639dcdc-94ed-4237-b665-407c781280fe None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:47.205433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b639dcdc-94ed-4237-b665-407c781280fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:47.303606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639dcdc-94ed-4237-b665-407c781280fe None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:47.371364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:47.371992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:47.372273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:47.372577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:47.374190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:47.475327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:47.476709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6d91f-1c59-4231-9b5d-87bcdcf79b45 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:47.494244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 641/1320] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:23:50.921243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35529-ca4d-4a52-8751-3513cb5d5f10 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:50.921746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35529-ca4d-4a52-8751-3513cb5d5f10 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:50.921746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35529-ca4d-4a52-8751-3513cb5d5f10 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:50.923525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 680/1321] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:50.928586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34c5a-b707-4934-a663-15b4a9f7cc8f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:50.928975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34c5a-b707-4934-a663-15b4a9f7cc8f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:50.929142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34c5a-b707-4934-a663-15b4a9f7cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:50.990308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b5e34c5a-b707-4934-a663-15b4a9f7cc8f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:50.991478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b5e34c5a-b707-4934-a663-15b4a9f7cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:51.082365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 642/1322] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:51.122138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35529-ca4d-4a52-8751-3513cb5d5f10 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:51.123703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d9e35529-ca4d-4a52-8751-3513cb5d5f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:51.223624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35529-ca4d-4a52-8751-3513cb5d5f10 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:51.292759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:51.293391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:51.293674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:51.293948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:51.295571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:51.399677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:51.401148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fab23-491a-4ea7-8964-87b08360b4d1 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:51.419139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 681/1323] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:23:54.693482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce84a5-ac29-42b5-8a93-740d91ff9bd5 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:54.694024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce84a5-ac29-42b5-8a93-740d91ff9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:54.694024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce84a5-ac29-42b5-8a93-740d91ff9bd5 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:54.695866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 643/1324] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:54.701336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cde12-dcaa-4910-b1fb-ea5edeb5e71a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:54.701749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cde12-dcaa-4910-b1fb-ea5edeb5e71a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:54.701897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cde12-dcaa-4910-b1fb-ea5edeb5e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:54.767419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c50cde12-dcaa-4910-b1fb-ea5edeb5e71a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:54.768640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c50cde12-dcaa-4910-b1fb-ea5edeb5e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:54.861864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 682/1325] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:54.897233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce84a5-ac29-42b5-8a93-740d91ff9bd5 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:54.898752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-10ce84a5-ac29-42b5-8a93-740d91ff9bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:54.997163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce84a5-ac29-42b5-8a93-740d91ff9bd5 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:55.067108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:55.067746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:55.068025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:55.068294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:55.069937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:55.175497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:55.176978 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cecd8-a3ac-42e2-a60b-cb2fdbfe774a service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:55.194611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 644/1326] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:23:57.545043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ba0ca-6994-4c1c-97f8-d83b86c778f6 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:57.545545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ba0ca-6994-4c1c-97f8-d83b86c778f6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:57.545545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ba0ca-6994-4c1c-97f8-d83b86c778f6 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:57.547338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 683/1327] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:23:57.552550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f5e4-8caf-4d47-be58-9559a44b9d8f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:57.552936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f5e4-8caf-4d47-be58-9559a44b9d8f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:57.553108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f5e4-8caf-4d47-be58-9559a44b9d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:57.616089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-6304f5e4-8caf-4d47-be58-9559a44b9d8f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:23:57.617352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6304f5e4-8caf-4d47-be58-9559a44b9d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:57.717660 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 645/1328] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:23:57.753885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ba0ca-6994-4c1c-97f8-d83b86c778f6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:57.755481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1c5ba0ca-6994-4c1c-97f8-d83b86c778f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:57.859841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ba0ca-6994-4c1c-97f8-d83b86c778f6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:57.932903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:57.933549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:57.933833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:57.934110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:57.935751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:23:58.038912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:58.040953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d9740-0ae9-4f01-b6c0-69cbc36ba251 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:58.058637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 684/1329] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:00.432145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498b3e0-e4ad-43ad-bfea-0c5671afe8b3 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:00.432718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498b3e0-e4ad-43ad-bfea-0c5671afe8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:00.432718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498b3e0-e4ad-43ad-bfea-0c5671afe8b3 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:00.434513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 646/1330] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:00.439759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9519-c043-4bd7-9e45-f9b01c8a1082 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:00.440176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9519-c043-4bd7-9e45-f9b01c8a1082 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:00.440443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9519-c043-4bd7-9e45-f9b01c8a1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:00.503911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-42ca9519-c043-4bd7-9e45-f9b01c8a1082 None None] MFA Rules not processed for user `8e0324dddc2245d1a18abd9fe6173b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:00.505168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-42ca9519-c043-4bd7-9e45-f9b01c8a1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:00.598455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 685/1331] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:24:00.636207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498b3e0-e4ad-43ad-bfea-0c5671afe8b3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:00.637762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f498b3e0-e4ad-43ad-bfea-0c5671afe8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:00.739524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498b3e0-e4ad-43ad-bfea-0c5671afe8b3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:00.810027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:00.810673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:00.810957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:00.811230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:00.812877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:00.916647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:00.918073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dff74b-f862-4fe8-a8c2-e3affc9641a5 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:00.935483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 647/1332] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:03.585185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80c9f-2dfc-40a7-b623-e39a8c4deef2 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:03.585691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80c9f-2dfc-40a7-b623-e39a8c4deef2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:03.585691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80c9f-2dfc-40a7-b623-e39a8c4deef2 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:03.587410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 686/1333] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:03.592689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037446-21ff-44ba-b39d-3009c20353e5 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:03.593094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037446-21ff-44ba-b39d-3009c20353e5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:03.593234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037446-21ff-44ba-b39d-3009c20353e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:03.656697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4f037446-21ff-44ba-b39d-3009c20353e5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:03.657921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4f037446-21ff-44ba-b39d-3009c20353e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:03.753407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 648/1334] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:03.794917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80c9f-2dfc-40a7-b623-e39a8c4deef2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:03.796526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b5a80c9f-2dfc-40a7-b623-e39a8c4deef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:03.907845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80c9f-2dfc-40a7-b623-e39a8c4deef2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:03.981800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:03.982449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:03.982726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:03.982995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:03.984655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:04.095005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:04.096488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09845f-dd84-4625-ba0c-f8d0b5db5163 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:04.115336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 687/1335] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:06.479202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a85f83-0aca-4f17-bfb1-ea17cba0e277 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:06.479723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a85f83-0aca-4f17-bfb1-ea17cba0e277 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:06.479723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a85f83-0aca-4f17-bfb1-ea17cba0e277 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:06.481505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 649/1336] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:06.486686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366c4f-0967-455d-8f85-ae84a2f4efc2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:06.487105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366c4f-0967-455d-8f85-ae84a2f4efc2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:06.487221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366c4f-0967-455d-8f85-ae84a2f4efc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:06.550709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-d2366c4f-0967-455d-8f85-ae84a2f4efc2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:06.551897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d2366c4f-0967-455d-8f85-ae84a2f4efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:06.647220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 688/1337] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:06.688450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a85f83-0aca-4f17-bfb1-ea17cba0e277 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:06.689995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-76a85f83-0aca-4f17-bfb1-ea17cba0e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:06.788957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a85f83-0aca-4f17-bfb1-ea17cba0e277 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:06.858634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:06.859273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:06.859554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:06.859827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:06.861502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:06.965716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:06.967143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43471-773b-47bc-aa11-4db0824305e5 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:06.984300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 650/1338] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:10.202319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ae3f-a5a8-4e0e-b165-b256a3b1ac34 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:10.202919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ae3f-a5a8-4e0e-b165-b256a3b1ac34 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:10.202919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ae3f-a5a8-4e0e-b165-b256a3b1ac34 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:10.204699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 689/1339] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:10.210000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b39b-e2d1-4eeb-ba02-c87cc3c079ce None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:10.210413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b39b-e2d1-4eeb-ba02-c87cc3c079ce None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:10.210554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b39b-e2d1-4eeb-ba02-c87cc3c079ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:10.277219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5cc0b39b-e2d1-4eeb-ba02-c87cc3c079ce None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:10.278404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5cc0b39b-e2d1-4eeb-ba02-c87cc3c079ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:10.375979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 651/1340] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:10.411759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434ae3f-a5a8-4e0e-b165-b256a3b1ac34 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:10.413994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1434ae3f-a5a8-4e0e-b165-b256a3b1ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:10.512884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434ae3f-a5a8-4e0e-b165-b256a3b1ac34 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:10.516486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5824e-988b-4457-aef4-35504fb69cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:10.517127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5824e-988b-4457-aef4-35504fb69cbb service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:10.517414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5824e-988b-4457-aef4-35504fb69cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:10.517694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5824e-988b-4457-aef4-35504fb69cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:10.527090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5824e-988b-4457-aef4-35504fb69cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:10.528565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5824e-988b-4457-aef4-35504fb69cbb service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:10.537631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 690/1341] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:14.999906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7d18a-4da9-441d-932b-904db6cf2348 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:15.000400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7d18a-4da9-441d-932b-904db6cf2348 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:15.000400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7d18a-4da9-441d-932b-904db6cf2348 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:15.002242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 652/1342] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:15.007662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258c3d-93d0-4f9b-98db-89a78d037a12 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:15.008095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258c3d-93d0-4f9b-98db-89a78d037a12 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:15.008256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258c3d-93d0-4f9b-98db-89a78d037a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:15.038342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b4258c3d-93d0-4f9b-98db-89a78d037a12 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:15.041316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b4258c3d-93d0-4f9b-98db-89a78d037a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:15.127189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 691/1343] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:15.158079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7d18a-4da9-441d-932b-904db6cf2348 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:15.169863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7d18a-4da9-441d-932b-904db6cf2348 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:15.173646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607e5bb-e815-4857-9cb4-356c2bb9abd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:15.174300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607e5bb-e815-4857-9cb4-356c2bb9abd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:15.174582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607e5bb-e815-4857-9cb4-356c2bb9abd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:15.174855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607e5bb-e815-4857-9cb4-356c2bb9abd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:15.185196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607e5bb-e815-4857-9cb4-356c2bb9abd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:15.186634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607e5bb-e815-4857-9cb4-356c2bb9abd6 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:15.197678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 653/1344] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:18.396244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e545-3c40-445b-90cd-ab33070eb8ad None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:18.396829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e545-3c40-445b-90cd-ab33070eb8ad None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:18.396829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e545-3c40-445b-90cd-ab33070eb8ad None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:18.398746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 692/1345] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:18.403816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277e53-83bf-473b-9ed6-ec1cf256b67c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:18.404268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277e53-83bf-473b-9ed6-ec1cf256b67c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:18.404362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277e53-83bf-473b-9ed6-ec1cf256b67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:18.422161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-24277e53-83bf-473b-9ed6-ec1cf256b67c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:18.423350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-24277e53-83bf-473b-9ed6-ec1cf256b67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:18.431539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 654/1346] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:18.467528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e545-3c40-445b-90cd-ab33070eb8ad None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:18.469249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b540e545-3c40-445b-90cd-ab33070eb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:18.482370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e545-3c40-445b-90cd-ab33070eb8ad None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:18.485863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560d03-73fd-4d94-9aa9-02ac1a63b861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:18.486495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560d03-73fd-4d94-9aa9-02ac1a63b861 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:18.486778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560d03-73fd-4d94-9aa9-02ac1a63b861 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:18.487053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560d03-73fd-4d94-9aa9-02ac1a63b861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:18.496568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12560d03-73fd-4d94-9aa9-02ac1a63b861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:18.498001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12560d03-73fd-4d94-9aa9-02ac1a63b861 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:18.516670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 693/1347] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:23.479328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ede47-ab24-48d4-ba35-a36eb50c781c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:23.479842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ede47-ab24-48d4-ba35-a36eb50c781c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:23.479938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ede47-ab24-48d4-ba35-a36eb50c781c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:23.481689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 655/1348] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:23.487166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd80e-91f8-4f61-9a04-d8e91f9fa768 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:23.487613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd80e-91f8-4f61-9a04-d8e91f9fa768 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:23.487727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd80e-91f8-4f61-9a04-d8e91f9fa768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:23.506417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6c7bd80e-91f8-4f61-9a04-d8e91f9fa768 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:23.507666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6c7bd80e-91f8-4f61-9a04-d8e91f9fa768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:23.515587 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 694/1349] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:23.554286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ede47-ab24-48d4-ba35-a36eb50c781c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:23.565750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ede47-ab24-48d4-ba35-a36eb50c781c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:23.569321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495352-3fea-4efa-96e4-7091338ff650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:23.569950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495352-3fea-4efa-96e4-7091338ff650 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:23.570227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495352-3fea-4efa-96e4-7091338ff650 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:23.570497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495352-3fea-4efa-96e4-7091338ff650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:23.580116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495352-3fea-4efa-96e4-7091338ff650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:23.581595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495352-3fea-4efa-96e4-7091338ff650 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:23.591039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 656/1350] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:28.753947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3eadf-25e9-4c9f-8997-39d95e39108c None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:28.754426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3eadf-25e9-4c9f-8997-39d95e39108c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:28.754426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3eadf-25e9-4c9f-8997-39d95e39108c None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:28.756480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 695/1351] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:28.762650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f006f-9487-4677-8a60-bb8b21d5cdb7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:28.763060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f006f-9487-4677-8a60-bb8b21d5cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:28.763199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f006f-9487-4677-8a60-bb8b21d5cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:28.847252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ce5f006f-9487-4677-8a60-bb8b21d5cdb7 None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:28.848461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ce5f006f-9487-4677-8a60-bb8b21d5cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:28.965099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 657/1352] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:33.349128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c9617-81a5-4176-917d-e8e2a612bd45 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:33.349632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c9617-81a5-4176-917d-e8e2a612bd45 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:33.349711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c9617-81a5-4176-917d-e8e2a612bd45 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:33.352332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 696/1353] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:33.358704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11950-cb38-4d7a-9afd-245deada2624 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:33.359234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11950-cb38-4d7a-9afd-245deada2624 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:33.359956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11950-cb38-4d7a-9afd-245deada2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:33.379749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-66a11950-cb38-4d7a-9afd-245deada2624 None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:33.380981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-66a11950-cb38-4d7a-9afd-245deada2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:33.389822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 658/1354] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:34.826113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a774-7ce7-4407-8376-aa73e423ce44 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:34.826647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a774-7ce7-4407-8376-aa73e423ce44 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:34.826739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a774-7ce7-4407-8376-aa73e423ce44 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:34.828522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 697/1355] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:34.917564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef03a4-e676-4e57-b58a-953688c17076 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:34.918091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef03a4-e676-4e57-b58a-953688c17076 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:34.918198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef03a4-e676-4e57-b58a-953688c17076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:34.936944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-16ef03a4-e676-4e57-b58a-953688c17076 None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:34.938200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-16ef03a4-e676-4e57-b58a-953688c17076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:34.947111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 659/1356] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:38.893747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d193bd-5a1e-4005-aca4-569ed08c4d2e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:38.894279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d193bd-5a1e-4005-aca4-569ed08c4d2e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:38.894279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d193bd-5a1e-4005-aca4-569ed08c4d2e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:38.896178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 698/1357] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:38.901810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8c852-c5bf-4e8b-8e51-6c07ff7d69f4 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:38.902250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8c852-c5bf-4e8b-8e51-6c07ff7d69f4 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:38.902345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8c852-c5bf-4e8b-8e51-6c07ff7d69f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:38.920589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b0a8c852-c5bf-4e8b-8e51-6c07ff7d69f4 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:38.921772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b0a8c852-c5bf-4e8b-8e51-6c07ff7d69f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:38.929828 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 660/1358] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:38.978544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abeaa-31e8-4f6c-8753-0355b04adf50 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:38.978826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abeaa-31e8-4f6c-8753-0355b04adf50 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:38.979103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abeaa-31e8-4f6c-8753-0355b04adf50 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:38.980995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 699/1359] 10.222.0.90 () {54 vars in 961 bytes} [Mon Feb 21 01:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:38.986587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b953c1b-18b7-495a-ac01-8481157ce5e0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:38.986983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b953c1b-18b7-495a-ac01-8481157ce5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:38.987299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b953c1b-18b7-495a-ac01-8481157ce5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:39.057103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5b953c1b-18b7-495a-ac01-8481157ce5e0 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:39.058273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5b953c1b-18b7-495a-ac01-8481157ce5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:39.142871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 661/1360] 10.222.0.90 () {58 vars in 1058 bytes} [Mon Feb 21 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:39.203803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abeaa-31e8-4f6c-8753-0355b04adf50 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:39.203803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abeaa-31e8-4f6c-8753-0355b04adf50 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:39.203803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6497a7-6db8-4f20-97fa-a392e04c0d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:39.203803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6497a7-6db8-4f20-97fa-a392e04c0d83 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:39.205138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6497a7-6db8-4f20-97fa-a392e04c0d83 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:39.205138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6497a7-6db8-4f20-97fa-a392e04c0d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:39.205138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6497a7-6db8-4f20-97fa-a392e04c0d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:39.205138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6497a7-6db8-4f20-97fa-a392e04c0d83 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:39.205138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 700/1361] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:24:41.758979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8c145-9cc8-4cad-9b40-e7772da541cf None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:41.759664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8c145-9cc8-4cad-9b40-e7772da541cf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:41.759664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8c145-9cc8-4cad-9b40-e7772da541cf None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:41.767032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf458-909c-49c4-8208-64db76ee804a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:41.767889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf458-909c-49c4-8208-64db76ee804a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:41.768333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf458-909c-49c4-8208-64db76ee804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:41.772074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 662/1362] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:41.787492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0a4bf458-909c-49c4-8208-64db76ee804a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:41.789063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0a4bf458-909c-49c4-8208-64db76ee804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:41.803695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 701/1363] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:24:41.842152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8c145-9cc8-4cad-9b40-e7772da541cf None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:41.856961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8c145-9cc8-4cad-9b40-e7772da541cf None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:41.862471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4df5c7-34c3-486f-bdb2-f5548b829b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:41.863112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4df5c7-34c3-486f-bdb2-f5548b829b7a service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:41.863395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4df5c7-34c3-486f-bdb2-f5548b829b7a service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:41.863673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4df5c7-34c3-486f-bdb2-f5548b829b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:41.872970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4df5c7-34c3-486f-bdb2-f5548b829b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:41.874694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4df5c7-34c3-486f-bdb2-f5548b829b7a service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:41.885407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 663/1364] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:44.715083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d99192-1d3b-4673-98ff-b7e5738e19ee None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:44.715589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d99192-1d3b-4673-98ff-b7e5738e19ee None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:44.715715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d99192-1d3b-4673-98ff-b7e5738e19ee None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:44.717486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 702/1365] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:44.723416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb31b8-304a-4011-aa51-3636e6fbcc70 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:44.724177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb31b8-304a-4011-aa51-3636e6fbcc70 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:44.724708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb31b8-304a-4011-aa51-3636e6fbcc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:44.747345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8cdb31b8-304a-4011-aa51-3636e6fbcc70 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:44.748767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8cdb31b8-304a-4011-aa51-3636e6fbcc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:44.757626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 664/1366] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:44.803584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38c9b-6760-41d4-8fe7-fd9527c6e138 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:44.804681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38c9b-6760-41d4-8fe7-fd9527c6e138 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:44.805041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb38c9b-6760-41d4-8fe7-fd9527c6e138 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:44.807053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 703/1367] 10.222.0.90 () {54 vars in 961 bytes} [Mon Feb 21 01:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:44.813059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c56e-a703-45a7-b42d-99f33abfd970 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:44.813627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c56e-a703-45a7-b42d-99f33abfd970 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:44.814105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c56e-a703-45a7-b42d-99f33abfd970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:44.834293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8193c56e-a703-45a7-b42d-99f33abfd970 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:44.836125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8193c56e-a703-45a7-b42d-99f33abfd970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:44.845902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 665/1368] 10.222.0.90 () {58 vars in 1058 bytes} [Mon Feb 21 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:44.854108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb38c9b-6760-41d4-8fe7-fd9527c6e138 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:44.871875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb38c9b-6760-41d4-8fe7-fd9527c6e138 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:44.879516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d928e-2b8b-4611-9d61-1373532c13cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:44.879516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d928e-2b8b-4611-9d61-1373532c13cb service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:44.879516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d928e-2b8b-4611-9d61-1373532c13cb service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:44.879516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d928e-2b8b-4611-9d61-1373532c13cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:44.889147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d928e-2b8b-4611-9d61-1373532c13cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:44.890762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d928e-2b8b-4611-9d61-1373532c13cb service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:44.901578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 704/1369] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:24:47.175339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e211ed-5471-469f-8256-9c95139a4265 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.176200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e211ed-5471-469f-8256-9c95139a4265 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.176706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e211ed-5471-469f-8256-9c95139a4265 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.178706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 666/1370] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:47.184096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def740-38fb-4921-9abe-765e987a4bd5 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.184614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def740-38fb-4921-9abe-765e987a4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.184703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def740-38fb-4921-9abe-765e987a4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.202119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-13def740-38fb-4921-9abe-765e987a4bd5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:47.203300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-13def740-38fb-4921-9abe-765e987a4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:47.211760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 705/1371] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:47.453750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ef51b-f87a-4e38-825a-9cf4d17ab367 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.453964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ef51b-f87a-4e38-825a-9cf4d17ab367 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.454526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ef51b-f87a-4e38-825a-9cf4d17ab367 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.456410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 667/1372] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:47.461881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.462165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.462604 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.464296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d63c-2639-4eab-8fd7-714299ecb579 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.464697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d63c-2639-4eab-8fd7-714299ecb579 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.465051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d63c-2639-4eab-8fd7-714299ecb579 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.466783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 668/1373] 10.222.0.90 () {54 vars in 963 bytes} [Mon Feb 21 01:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:47.472976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1bb7d-04f3-43d8-a0ff-d2e30fafa773 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.473438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1bb7d-04f3-43d8-a0ff-d2e30fafa773 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.473879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1bb7d-04f3-43d8-a0ff-d2e30fafa773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.481889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:47.483164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:47.492123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 706/1374] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:47.529394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2ae1bb7d-04f3-43d8-a0ff-d2e30fafa773 None None] MFA Rules not processed for user `89e39e92f70b45e39ae07a123beff178`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:47.531020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2ae1bb7d-04f3-43d8-a0ff-d2e30fafa773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:47.536849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:47.550226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310bf7-ec38-4343-b335-1bb3c5374cc8 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:47.556415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:47.557204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.557707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.558093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.566844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:47.568597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:47.579834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 707/1375] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:47.591851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 669/1376] 10.222.0.90 () {58 vars in 1060 bytes} [Mon Feb 21 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:47.599465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:47.608887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bcbdb-11e3-4d07-8aeb-6bbc573602cc service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:47.612927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af10fd7-8fd0-4b69-8997-a75e7712671d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:47.613641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10fd7-8fd0-4b69-8997-a75e7712671d service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:47.614097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10fd7-8fd0-4b69-8997-a75e7712671d service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:47.614439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10fd7-8fd0-4b69-8997-a75e7712671d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:47.624739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af10fd7-8fd0-4b69-8997-a75e7712671d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:47.626181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af10fd7-8fd0-4b69-8997-a75e7712671d service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:47.636126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 708/1377] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:50.147236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5080-4242-41a5-a872-99d7b9d1fd34 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.147755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5080-4242-41a5-a872-99d7b9d1fd34 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.147853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5080-4242-41a5-a872-99d7b9d1fd34 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.149799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 670/1378] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:50.155002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cc55-fc1d-4468-9637-9ea430e296c7 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.155437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cc55-fc1d-4468-9637-9ea430e296c7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.155569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cc55-fc1d-4468-9637-9ea430e296c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.172955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ff38cc55-fc1d-4468-9637-9ea430e296c7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:50.174139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ff38cc55-fc1d-4468-9637-9ea430e296c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:50.182449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 709/1379] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:50.232818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5080-4242-41a5-a872-99d7b9d1fd34 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:50.247546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5080-4242-41a5-a872-99d7b9d1fd34 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:50.252892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0669871-bbc0-4c23-87a0-d7b455a79d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:50.253788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669871-bbc0-4c23-87a0-d7b455a79d1b service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:50.254067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669871-bbc0-4c23-87a0-d7b455a79d1b service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:50.254341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669871-bbc0-4c23-87a0-d7b455a79d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:50.263119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0669871-bbc0-4c23-87a0-d7b455a79d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:50.264778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0669871-bbc0-4c23-87a0-d7b455a79d1b service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:50.274272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 671/1380] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:52.820678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537598c-1bd1-4c03-8521-91c6c9be27b3 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.821232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537598c-1bd1-4c03-8521-91c6c9be27b3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.821232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537598c-1bd1-4c03-8521-91c6c9be27b3 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.823090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 710/1381] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:52.828330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ede4b8-28ae-4fc2-a6f1-19f04edd70dd None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.828797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ede4b8-28ae-4fc2-a6f1-19f04edd70dd None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.829064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ede4b8-28ae-4fc2-a6f1-19f04edd70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.847112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-54ede4b8-28ae-4fc2-a6f1-19f04edd70dd None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:52.848280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-54ede4b8-28ae-4fc2-a6f1-19f04edd70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:52.857813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 672/1382] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:52.901381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537598c-1bd1-4c03-8521-91c6c9be27b3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:52.916057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537598c-1bd1-4c03-8521-91c6c9be27b3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:52.921414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db992d-6719-4235-b361-d3b999fa923d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:52.922056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db992d-6719-4235-b361-d3b999fa923d service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:52.922333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db992d-6719-4235-b361-d3b999fa923d service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:52.922799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db992d-6719-4235-b361-d3b999fa923d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:52.936261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db992d-6719-4235-b361-d3b999fa923d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:52.938093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db992d-6719-4235-b361-d3b999fa923d service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:52.948683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 711/1383] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:55.455751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b728-bb14-418e-9f0a-f070040a91ae None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:55.456564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b728-bb14-418e-9f0a-f070040a91ae None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:55.456564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b728-bb14-418e-9f0a-f070040a91ae None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:55.459267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 673/1384] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:55.467305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea0fd-8372-4e1b-b99f-4a8892595215 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:55.467828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea0fd-8372-4e1b-b99f-4a8892595215 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:55.468094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea0fd-8372-4e1b-b99f-4a8892595215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:55.493419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-676ea0fd-8372-4e1b-b99f-4a8892595215 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:55.495131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-676ea0fd-8372-4e1b-b99f-4a8892595215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:55.506756 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 712/1385] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:24:55.549793 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b728-bb14-418e-9f0a-f070040a91ae None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:55.575588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b728-bb14-418e-9f0a-f070040a91ae None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:55.582963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2c06d-fb15-49c1-ad74-0518795eb32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:55.583746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c06d-fb15-49c1-ad74-0518795eb32d service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:55.584106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c06d-fb15-49c1-ad74-0518795eb32d service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:55.585031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c06d-fb15-49c1-ad74-0518795eb32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:55.601122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2c06d-fb15-49c1-ad74-0518795eb32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:55.604949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2c06d-fb15-49c1-ad74-0518795eb32d service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:55.621782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 674/1386] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:24:57.926622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50410e-b86f-46e5-a34a-d71e60804843 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.927147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50410e-b86f-46e5-a34a-d71e60804843 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.927321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50410e-b86f-46e5-a34a-d71e60804843 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.929793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 713/1387] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:24:57.935104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8e6b6-5526-4810-9f53-710b00acf783 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:57.935506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8e6b6-5526-4810-9f53-710b00acf783 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:57.935651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8e6b6-5526-4810-9f53-710b00acf783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:57.953664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e7d8e6b6-5526-4810-9f53-710b00acf783 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:24:57.954831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e7d8e6b6-5526-4810-9f53-710b00acf783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:24:57.962921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 675/1388] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:24:58.010947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50410e-b86f-46e5-a34a-d71e60804843 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:24:58.029058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50410e-b86f-46e5-a34a-d71e60804843 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:24:58.035780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b7d41-638b-4382-b58f-d97d258fc3a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:24:58.036589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b7d41-638b-4382-b58f-d97d258fc3a1 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:24:58.037017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b7d41-638b-4382-b58f-d97d258fc3a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:24:58.037376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b7d41-638b-4382-b58f-d97d258fc3a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:24:58.047731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b7d41-638b-4382-b58f-d97d258fc3a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:24:58.049439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b7d41-638b-4382-b58f-d97d258fc3a1 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:24:58.059816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 714/1389] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:00.763339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e5cd-0eef-425c-80c5-d292a382e3fe None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:00.764048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e5cd-0eef-425c-80c5-d292a382e3fe None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:00.764048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e5cd-0eef-425c-80c5-d292a382e3fe None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:00.765729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 676/1390] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:00.771357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d94bdc-e0ae-4b01-9cc8-2cb815189c62 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:00.772600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d94bdc-e0ae-4b01-9cc8-2cb815189c62 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:00.773587 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d94bdc-e0ae-4b01-9cc8-2cb815189c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:00.793755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-41d94bdc-e0ae-4b01-9cc8-2cb815189c62 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:00.794727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-41d94bdc-e0ae-4b01-9cc8-2cb815189c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:00.807369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 715/1391] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:00.858398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e5cd-0eef-425c-80c5-d292a382e3fe None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:00.875248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e5cd-0eef-425c-80c5-d292a382e3fe None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:00.878821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561af050-5a58-4863-8836-084637d4e817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:00.879445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561af050-5a58-4863-8836-084637d4e817 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:00.879727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561af050-5a58-4863-8836-084637d4e817 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:00.879997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561af050-5a58-4863-8836-084637d4e817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:00.889693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561af050-5a58-4863-8836-084637d4e817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:00.891313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561af050-5a58-4863-8836-084637d4e817 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:00.903914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 677/1392] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:25:03.071893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0ac2c-ad26-410a-af03-0d713ee9b1cd None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.072463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0ac2c-ad26-410a-af03-0d713ee9b1cd None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.072463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0ac2c-ad26-410a-af03-0d713ee9b1cd None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.074269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 716/1393] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:03.079576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a2a6-7003-4097-b0ed-ca04c19b66b8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.079981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a2a6-7003-4097-b0ed-ca04c19b66b8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.080116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a2a6-7003-4097-b0ed-ca04c19b66b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.098871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2fb1a2a6-7003-4097-b0ed-ca04c19b66b8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:03.100632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2fb1a2a6-7003-4097-b0ed-ca04c19b66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:03.108273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 678/1394] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:03.166005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940aba-01f5-4900-ae0c-6d6d0e82246c None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.166380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940aba-01f5-4900-ae0c-6d6d0e82246c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.166725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940aba-01f5-4900-ae0c-6d6d0e82246c None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.168621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 717/1395] 10.222.0.90 () {54 vars in 962 bytes} [Mon Feb 21 01:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:03.174100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0da916-81b6-4473-9bcd-2b17d2ce95c0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.174494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0da916-81b6-4473-9bcd-2b17d2ce95c0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.174856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0da916-81b6-4473-9bcd-2b17d2ce95c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.222659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5a0da916-81b6-4473-9bcd-2b17d2ce95c0 None None] MFA Rules not processed for user `5f7d6c94406d4ae0aac5f772ff240ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:03.223830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5a0da916-81b6-4473-9bcd-2b17d2ce95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:03.280714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 679/1396] 10.222.0.90 () {58 vars in 1059 bytes} [Mon Feb 21 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:03.288048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940aba-01f5-4900-ae0c-6d6d0e82246c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:03.298714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940aba-01f5-4900-ae0c-6d6d0e82246c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:03.302328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a6b72-4bd0-4741-b69c-179d18d0717c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:03.303027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6b72-4bd0-4741-b69c-179d18d0717c service glance] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.303399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6b72-4bd0-4741-b69c-179d18d0717c service glance] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.303745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6b72-4bd0-4741-b69c-179d18d0717c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.312598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a6b72-4bd0-4741-b69c-179d18d0717c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:03.314110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a6b72-4bd0-4741-b69c-179d18d0717c service glance] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:03.324038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 718/1397] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:03.514694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8b445-c7d2-4ff0-bd84-3b3d7511d43d None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.514987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8b445-c7d2-4ff0-bd84-3b3d7511d43d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.515267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8b445-c7d2-4ff0-bd84-3b3d7511d43d None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.517120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 680/1398] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:03.522921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215dece-bf98-4581-925d-8fc7baf55651 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.523301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215dece-bf98-4581-925d-8fc7baf55651 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.523584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215dece-bf98-4581-925d-8fc7baf55651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.541770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-7215dece-bf98-4581-925d-8fc7baf55651 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:03.543006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7215dece-bf98-4581-925d-8fc7baf55651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:03.550849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 719/1399] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:03.598855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8b445-c7d2-4ff0-bd84-3b3d7511d43d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:03.623877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8b445-c7d2-4ff0-bd84-3b3d7511d43d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:03.629982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fc570-e7b7-4166-bfcc-bc557b39abb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:03.630770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc570-e7b7-4166-bfcc-bc557b39abb9 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.631057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc570-e7b7-4166-bfcc-bc557b39abb9 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.631333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc570-e7b7-4166-bfcc-bc557b39abb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.640548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fc570-e7b7-4166-bfcc-bc557b39abb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:03.642178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fc570-e7b7-4166-bfcc-bc557b39abb9 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:03.652391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 681/1400] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:03.898431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5375e-d375-45c5-823a-9536194f0e3d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:03.900451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5375e-d375-45c5-823a-9536194f0e3d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:03.900451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5375e-d375-45c5-823a-9536194f0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:03.954425 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-80c5375e-d375-45c5-823a-9536194f0e3d None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:03.955661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-80c5375e-d375-45c5-823a-9536194f0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:04.024819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 720/1401] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:04.068971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac941-eb36-4e30-becc-38302166d6fe None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:04.069245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac941-eb36-4e30-becc-38302166d6fe None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:04.069524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac941-eb36-4e30-becc-38302166d6fe None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:04.071498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 682/1402] 10.222.0.90 () {54 vars in 942 bytes} [Mon Feb 21 01:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:04.077929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30c7a-1fb6-4306-bd91-b7f499d0907a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:04.078400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30c7a-1fb6-4306-bd91-b7f499d0907a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:04.078657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30c7a-1fb6-4306-bd91-b7f499d0907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:04.132198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f1d30c7a-1fb6-4306-bd91-b7f499d0907a None None] MFA Rules not processed for user `f126d69c4bcf42aaa7d5b85e40e93582`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:04.133472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f1d30c7a-1fb6-4306-bd91-b7f499d0907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:04.207765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 721/1403] 10.222.0.90 () {58 vars in 1039 bytes} [Mon Feb 21 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:04.218876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aac941-eb36-4e30-becc-38302166d6fe None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:04.232453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aac941-eb36-4e30-becc-38302166d6fe None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:04.237596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c3a1-70e8-4ab9-9376-f0b3876f78c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:04.244045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c3a1-70e8-4ab9-9376-f0b3876f78c8 service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:04.244045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c3a1-70e8-4ab9-9376-f0b3876f78c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:04.244045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c3a1-70e8-4ab9-9376-f0b3876f78c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:04.247785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c3a1-70e8-4ab9-9376-f0b3876f78c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:04.249748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c3a1-70e8-4ab9-9376-f0b3876f78c8 service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:04.258761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 683/1404] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:25:06.117283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008dde1-168a-433b-9a18-f3c106a60e4b None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.118177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008dde1-168a-433b-9a18-f3c106a60e4b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.118459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008dde1-168a-433b-9a18-f3c106a60e4b None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.120243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 722/1405] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:06.125440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202e03c-72e7-4c64-9d98-142992d7f063 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.125863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202e03c-72e7-4c64-9d98-142992d7f063 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.126022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202e03c-72e7-4c64-9d98-142992d7f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.145505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3202e03c-72e7-4c64-9d98-142992d7f063 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:06.146751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3202e03c-72e7-4c64-9d98-142992d7f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:06.156463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 684/1406] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:06.200274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008dde1-168a-433b-9a18-f3c106a60e4b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:06.217231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008dde1-168a-433b-9a18-f3c106a60e4b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:06.223983 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e13dbf-937f-4dec-8d54-13ddac5ce848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:06.226707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e13dbf-937f-4dec-8d54-13ddac5ce848 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:06.226707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e13dbf-937f-4dec-8d54-13ddac5ce848 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:06.226707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e13dbf-937f-4dec-8d54-13ddac5ce848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:06.237044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e13dbf-937f-4dec-8d54-13ddac5ce848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:06.239246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e13dbf-937f-4dec-8d54-13ddac5ce848 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:06.249086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 723/1407] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:08.764630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421b411-2550-4c8f-971f-4880022c2921 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:08.765444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421b411-2550-4c8f-971f-4880022c2921 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:08.765444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421b411-2550-4c8f-971f-4880022c2921 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:08.766963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 685/1408] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:08.772744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104934da-e24d-4092-98be-aa7617d94c24 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:08.773173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104934da-e24d-4092-98be-aa7617d94c24 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:08.773390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104934da-e24d-4092-98be-aa7617d94c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:08.794830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-104934da-e24d-4092-98be-aa7617d94c24 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:08.796026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-104934da-e24d-4092-98be-aa7617d94c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:08.806084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 724/1409] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:08.849590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421b411-2550-4c8f-971f-4880022c2921 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:08.864692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421b411-2550-4c8f-971f-4880022c2921 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:08.872297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a6c0a-c40a-476c-ba38-609e8cd60b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:08.872915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6c0a-c40a-476c-ba38-609e8cd60b39 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:08.873199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6c0a-c40a-476c-ba38-609e8cd60b39 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:08.873464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6c0a-c40a-476c-ba38-609e8cd60b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:08.882544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a6c0a-c40a-476c-ba38-609e8cd60b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:08.884216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a6c0a-c40a-476c-ba38-609e8cd60b39 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:08.894280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 686/1410] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:28.582673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed050fad-c6e3-4822-8ff8-6ee8c36b1052 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:28.583373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed050fad-c6e3-4822-8ff8-6ee8c36b1052 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:28.583373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed050fad-c6e3-4822-8ff8-6ee8c36b1052 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:28.585105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 725/1411] 10.222.0.90 () {54 vars in 918 bytes} [Mon Feb 21 01:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:28.590499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c445b0-e90d-4c87-a328-e46648854680 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:28.590964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c445b0-e90d-4c87-a328-e46648854680 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:28.591075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c445b0-e90d-4c87-a328-e46648854680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:28.608347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-66c445b0-e90d-4c87-a328-e46648854680 None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:28.609551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-66c445b0-e90d-4c87-a328-e46648854680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:28.618554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 687/1412] 10.222.0.90 () {58 vars in 1015 bytes} [Mon Feb 21 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:25:28.633701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abaf89-7a84-43db-b185-94ccc9a1b7fe None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:28.633985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abaf89-7a84-43db-b185-94ccc9a1b7fe None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:28.634258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abaf89-7a84-43db-b185-94ccc9a1b7fe None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:28.636003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 726/1413] 10.222.0.90 () {54 vars in 918 bytes} [Mon Feb 21 01:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:28.640655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a6fe-63f2-4f5a-88ec-2f124fd4f486 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:28.640946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a6fe-63f2-4f5a-88ec-2f124fd4f486 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:28.641225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a6fe-63f2-4f5a-88ec-2f124fd4f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:28.658583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e3d9a6fe-63f2-4f5a-88ec-2f124fd4f486 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:28.659758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e3d9a6fe-63f2-4f5a-88ec-2f124fd4f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:28.672374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 688/1414] 10.222.0.90 () {58 vars in 1015 bytes} [Mon Feb 21 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:25:31.414889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715200-63b1-4768-8d85-7bc2c42fea0e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:31.415411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715200-63b1-4768-8d85-7bc2c42fea0e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:31.415534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715200-63b1-4768-8d85-7bc2c42fea0e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:31.417287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 727/1415] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:31.422533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88bb09-6c6c-4e17-b1df-74420c939c27 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:31.422970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88bb09-6c6c-4e17-b1df-74420c939c27 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:31.423075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88bb09-6c6c-4e17-b1df-74420c939c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:31.440824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ff88bb09-6c6c-4e17-b1df-74420c939c27 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:31.441987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ff88bb09-6c6c-4e17-b1df-74420c939c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:31.450233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 689/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:25:31.491754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715200-63b1-4768-8d85-7bc2c42fea0e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:31.506478 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715200-63b1-4768-8d85-7bc2c42fea0e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:31.511838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a266d-99f6-4811-9791-dec58c84a5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:31.512487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a266d-99f6-4811-9791-dec58c84a5d6 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:31.512773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a266d-99f6-4811-9791-dec58c84a5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:31.513049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a266d-99f6-4811-9791-dec58c84a5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:31.521201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a266d-99f6-4811-9791-dec58c84a5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:31.522767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a266d-99f6-4811-9791-dec58c84a5d6 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:31.531712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 728/1417] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:32.905882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f86c7c-7393-4be9-a6c1-62ba8786e67a None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.906427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f86c7c-7393-4be9-a6c1-62ba8786e67a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.906427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f86c7c-7393-4be9-a6c1-62ba8786e67a None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.908166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 690/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:32.913307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0cd0f-417b-4abd-b74b-917ea6b7cb00 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:32.913744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0cd0f-417b-4abd-b74b-917ea6b7cb00 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:32.913859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0cd0f-417b-4abd-b74b-917ea6b7cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:32.936670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a9b0cd0f-417b-4abd-b74b-917ea6b7cb00 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:32.937912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a9b0cd0f-417b-4abd-b74b-917ea6b7cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:32.946725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 729/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:33.109352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f86c7c-7393-4be9-a6c1-62ba8786e67a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:33.123795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f86c7c-7393-4be9-a6c1-62ba8786e67a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:33.129345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d48ed-d3b5-4d6e-bafc-19b3f2e2d342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:33.130558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d48ed-d3b5-4d6e-bafc-19b3f2e2d342 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:33.130843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d48ed-d3b5-4d6e-bafc-19b3f2e2d342 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:33.131115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d48ed-d3b5-4d6e-bafc-19b3f2e2d342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:33.139184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d48ed-d3b5-4d6e-bafc-19b3f2e2d342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:33.140796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d48ed-d3b5-4d6e-bafc-19b3f2e2d342 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:33.149777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 691/1420] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:34.451928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a99ea-78f5-42c1-afbe-0ebff7340f13 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:34.452513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a99ea-78f5-42c1-afbe-0ebff7340f13 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:34.452513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a99ea-78f5-42c1-afbe-0ebff7340f13 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:34.454267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 730/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:25:34.459825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7d15-e6d1-4d5e-b952-bc9abfc142c6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:34.460256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7d15-e6d1-4d5e-b952-bc9abfc142c6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:34.460384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7d15-e6d1-4d5e-b952-bc9abfc142c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:34.478603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-024b7d15-e6d1-4d5e-b952-bc9abfc142c6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:34.479792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-024b7d15-e6d1-4d5e-b952-bc9abfc142c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:34.487554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 692/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:34.638706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a99ea-78f5-42c1-afbe-0ebff7340f13 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:34.653471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a99ea-78f5-42c1-afbe-0ebff7340f13 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:34.659060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8788a-c30a-4660-967e-7e925024ac9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:34.659691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8788a-c30a-4660-967e-7e925024ac9f service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:34.659975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8788a-c30a-4660-967e-7e925024ac9f service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:34.660351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8788a-c30a-4660-967e-7e925024ac9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:34.668572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8788a-c30a-4660-967e-7e925024ac9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:34.670181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8788a-c30a-4660-967e-7e925024ac9f service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:34.679896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 731/1423] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:35.987323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d245-5c40-4de0-b7d2-be1dfb833bf2 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.987835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d245-5c40-4de0-b7d2-be1dfb833bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.987835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d245-5c40-4de0-b7d2-be1dfb833bf2 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:35.990161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 693/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:35.995223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dbf6-1604-4265-9d0b-0a6058767e5b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:35.995659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dbf6-1604-4265-9d0b-0a6058767e5b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:35.995759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dbf6-1604-4265-9d0b-0a6058767e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.014362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ebb7dbf6-1604-4265-9d0b-0a6058767e5b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:36.015556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ebb7dbf6-1604-4265-9d0b-0a6058767e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:36.023529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 732/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:36.173435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71d245-5c40-4de0-b7d2-be1dfb833bf2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:36.187826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71d245-5c40-4de0-b7d2-be1dfb833bf2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:36.193210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51da76b-9e09-4ccf-a93e-47ae7ff1dad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:36.193835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51da76b-9e09-4ccf-a93e-47ae7ff1dad9 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:36.194117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51da76b-9e09-4ccf-a93e-47ae7ff1dad9 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:36.194391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51da76b-9e09-4ccf-a93e-47ae7ff1dad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:36.202174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51da76b-9e09-4ccf-a93e-47ae7ff1dad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:36.203744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51da76b-9e09-4ccf-a93e-47ae7ff1dad9 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:36.212859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 694/1426] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:37.510379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccba381-8758-41f7-9852-ff7d504601ae None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.510891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccba381-8758-41f7-9852-ff7d504601ae None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.510891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccba381-8758-41f7-9852-ff7d504601ae None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.512658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 733/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:37.517578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed8b4-3a87-47e8-9abe-c5aae444070e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.518025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed8b4-3a87-47e8-9abe-c5aae444070e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.518172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed8b4-3a87-47e8-9abe-c5aae444070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.537193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8f6ed8b4-3a87-47e8-9abe-c5aae444070e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:37.538405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8f6ed8b4-3a87-47e8-9abe-c5aae444070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:37.546224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 695/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:37.705402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccba381-8758-41f7-9852-ff7d504601ae None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:37.719592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccba381-8758-41f7-9852-ff7d504601ae None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:37.725566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff71481-696e-4780-8b78-281d7b7d0c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:37.726199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff71481-696e-4780-8b78-281d7b7d0c8f service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:37.726480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff71481-696e-4780-8b78-281d7b7d0c8f service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:37.726755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff71481-696e-4780-8b78-281d7b7d0c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:37.734892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff71481-696e-4780-8b78-281d7b7d0c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:37.736515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff71481-696e-4780-8b78-281d7b7d0c8f service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:37.746279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 734/1429] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:39.060829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5529bd-4f19-4ef8-89fd-534298121707 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.061403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5529bd-4f19-4ef8-89fd-534298121707 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.061403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5529bd-4f19-4ef8-89fd-534298121707 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.063246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 696/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:39.068508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4690-ebbb-4652-823d-da788dc20529 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.069047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4690-ebbb-4652-823d-da788dc20529 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.069047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4690-ebbb-4652-823d-da788dc20529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.087486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-89bd4690-ebbb-4652-823d-da788dc20529 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:39.088661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-89bd4690-ebbb-4652-823d-da788dc20529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:39.096315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 735/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:39.248716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5529bd-4f19-4ef8-89fd-534298121707 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:39.262594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5529bd-4f19-4ef8-89fd-534298121707 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:39.268117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa6cf6-ed14-4877-9f82-0678737fb99d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:39.268764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6cf6-ed14-4877-9f82-0678737fb99d service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:39.269042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6cf6-ed14-4877-9f82-0678737fb99d service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:39.269309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6cf6-ed14-4877-9f82-0678737fb99d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:39.277009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa6cf6-ed14-4877-9f82-0678737fb99d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:39.278580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa6cf6-ed14-4877-9f82-0678737fb99d service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:39.288314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 697/1432] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:40.575706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a9e4-4676-4b07-884a-375d33b2e440 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.576268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a9e4-4676-4b07-884a-375d33b2e440 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.576268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a9e4-4676-4b07-884a-375d33b2e440 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.578066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 736/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:40.583004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e146a-6a68-42af-8acd-95136ced0c92 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.583428 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e146a-6a68-42af-8acd-95136ced0c92 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.583664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e146a-6a68-42af-8acd-95136ced0c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.601371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-609e146a-6a68-42af-8acd-95136ced0c92 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:40.602566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-609e146a-6a68-42af-8acd-95136ced0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:40.610267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 698/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:40.761905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a9e4-4676-4b07-884a-375d33b2e440 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:40.776562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a9e4-4676-4b07-884a-375d33b2e440 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:40.781949 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234aa7a-7c06-484e-ae5e-b68a10aca252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:40.782578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234aa7a-7c06-484e-ae5e-b68a10aca252 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:40.782863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234aa7a-7c06-484e-ae5e-b68a10aca252 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:40.783141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234aa7a-7c06-484e-ae5e-b68a10aca252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:40.791109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234aa7a-7c06-484e-ae5e-b68a10aca252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:40.792763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234aa7a-7c06-484e-ae5e-b68a10aca252 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:40.801866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 737/1435] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:42.150790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc2f35-4920-4388-831d-86f42109458d None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.151344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc2f35-4920-4388-831d-86f42109458d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.151344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc2f35-4920-4388-831d-86f42109458d None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.153162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 699/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:42.158143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd16b0c-90ed-473d-84ca-3bedf6b35dff None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.158552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd16b0c-90ed-473d-84ca-3bedf6b35dff None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.158723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd16b0c-90ed-473d-84ca-3bedf6b35dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.176665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-edd16b0c-90ed-473d-84ca-3bedf6b35dff None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:42.178058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-edd16b0c-90ed-473d-84ca-3bedf6b35dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:42.186067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 738/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:42.336441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc2f35-4920-4388-831d-86f42109458d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:42.360404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc2f35-4920-4388-831d-86f42109458d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:42.372966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6089f2-65dd-4e1a-9349-95bba16e957c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:42.373625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6089f2-65dd-4e1a-9349-95bba16e957c service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:42.373911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6089f2-65dd-4e1a-9349-95bba16e957c service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:42.374185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6089f2-65dd-4e1a-9349-95bba16e957c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:42.385512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6089f2-65dd-4e1a-9349-95bba16e957c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:42.387131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6089f2-65dd-4e1a-9349-95bba16e957c service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:42.396283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 700/1438] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:43.777519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c474577-934c-4f95-b23f-6003cb4ad935 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.778081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c474577-934c-4f95-b23f-6003cb4ad935 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.778081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c474577-934c-4f95-b23f-6003cb4ad935 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.779859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 739/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:43.785041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a830f2-e952-43ce-9789-cfd8022f0fb5 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.785503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a830f2-e952-43ce-9789-cfd8022f0fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.785598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a830f2-e952-43ce-9789-cfd8022f0fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.805634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d3a830f2-e952-43ce-9789-cfd8022f0fb5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:43.806819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d3a830f2-e952-43ce-9789-cfd8022f0fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:43.815324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 701/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:43.969655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c474577-934c-4f95-b23f-6003cb4ad935 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:43.983582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c474577-934c-4f95-b23f-6003cb4ad935 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:43.989353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdbed2-7874-465b-8b9f-e908f0d0290f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:43.989980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdbed2-7874-465b-8b9f-e908f0d0290f service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:43.990258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdbed2-7874-465b-8b9f-e908f0d0290f service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:43.990530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdbed2-7874-465b-8b9f-e908f0d0290f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:43.998259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdbed2-7874-465b-8b9f-e908f0d0290f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:43.999834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdbed2-7874-465b-8b9f-e908f0d0290f service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:44.009664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 740/1441] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:46.202269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0cbc-cb73-4aa9-a6f4-9faabc7267d8 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:46.202805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0cbc-cb73-4aa9-a6f4-9faabc7267d8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:46.202805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0cbc-cb73-4aa9-a6f4-9faabc7267d8 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:46.204675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 702/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:46.209807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3a8d6-2985-4706-8db7-eca99f7eb2bc None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:46.210196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3a8d6-2985-4706-8db7-eca99f7eb2bc None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:46.210419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3a8d6-2985-4706-8db7-eca99f7eb2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:46.228630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-34f3a8d6-2985-4706-8db7-eca99f7eb2bc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:46.229810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-34f3a8d6-2985-4706-8db7-eca99f7eb2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:46.237833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 741/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:46.276635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0cbc-cb73-4aa9-a6f4-9faabc7267d8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:46.287767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0cbc-cb73-4aa9-a6f4-9faabc7267d8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:46.291318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ed362-45b5-4bff-bf22-506bcac4ac30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:46.291947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ed362-45b5-4bff-bf22-506bcac4ac30 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:46.292232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ed362-45b5-4bff-bf22-506bcac4ac30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:46.292547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ed362-45b5-4bff-bf22-506bcac4ac30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:46.301163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ed362-45b5-4bff-bf22-506bcac4ac30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:46.302582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ed362-45b5-4bff-bf22-506bcac4ac30 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:46.311527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 703/1444] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:25:48.745463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1074-6053-47fa-ad81-4fa2bedc922a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.746061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1074-6053-47fa-ad81-4fa2bedc922a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.746061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1074-6053-47fa-ad81-4fa2bedc922a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.748218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 742/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:48.754924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90841cc-a5b6-4342-9d0e-83cb6f178795 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.755447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90841cc-a5b6-4342-9d0e-83cb6f178795 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.755542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90841cc-a5b6-4342-9d0e-83cb6f178795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.775125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f90841cc-a5b6-4342-9d0e-83cb6f178795 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:48.776296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f90841cc-a5b6-4342-9d0e-83cb6f178795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:48.783869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 704/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:48.822646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1074-6053-47fa-ad81-4fa2bedc922a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:48.833148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1074-6053-47fa-ad81-4fa2bedc922a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:48.836708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19864d1f-164f-4837-a756-7ab3c8c29f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:48.837340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19864d1f-164f-4837-a756-7ab3c8c29f43 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:48.837624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19864d1f-164f-4837-a756-7ab3c8c29f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:48.837900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19864d1f-164f-4837-a756-7ab3c8c29f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:48.846532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19864d1f-164f-4837-a756-7ab3c8c29f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:48.847975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19864d1f-164f-4837-a756-7ab3c8c29f43 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:48.857191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 743/1447] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:51.507915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc2ec-9e83-474f-b643-ae143f0a2262 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.508558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc2ec-9e83-474f-b643-ae143f0a2262 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.508558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc2ec-9e83-474f-b643-ae143f0a2262 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.510220 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 705/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:51.515598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a751c0-dcfc-4b4a-a202-f8c14334d163 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.516020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a751c0-dcfc-4b4a-a202-f8c14334d163 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.516179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a751c0-dcfc-4b4a-a202-f8c14334d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.535118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-09a751c0-dcfc-4b4a-a202-f8c14334d163 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:51.536978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-09a751c0-dcfc-4b4a-a202-f8c14334d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:51.544723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 744/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:51.583018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc2ec-9e83-474f-b643-ae143f0a2262 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:51.593300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc2ec-9e83-474f-b643-ae143f0a2262 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:51.596798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26773-a67e-45a3-897c-8ee7423eaa0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:51.597423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26773-a67e-45a3-897c-8ee7423eaa0f service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:51.597706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26773-a67e-45a3-897c-8ee7423eaa0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:51.598536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26773-a67e-45a3-897c-8ee7423eaa0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:51.607420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e26773-a67e-45a3-897c-8ee7423eaa0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:51.608890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e26773-a67e-45a3-897c-8ee7423eaa0f service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:51.618299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 706/1450] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:54.115276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ca73-9025-439a-b419-8862d6f42226 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:54.115912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ca73-9025-439a-b419-8862d6f42226 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:54.115912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ca73-9025-439a-b419-8862d6f42226 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:54.118022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 745/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:54.124565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06426b8-1b46-454f-81bb-00df48fdc511 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:54.125040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06426b8-1b46-454f-81bb-00df48fdc511 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:54.125294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06426b8-1b46-454f-81bb-00df48fdc511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:54.146444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f06426b8-1b46-454f-81bb-00df48fdc511 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:54.147701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f06426b8-1b46-454f-81bb-00df48fdc511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:54.155681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 707/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:54.194734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ca73-9025-439a-b419-8862d6f42226 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:54.205259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ca73-9025-439a-b419-8862d6f42226 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:54.209482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd878f1-ce9d-4af0-89b9-0d3a8e225c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:54.210106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd878f1-ce9d-4af0-89b9-0d3a8e225c33 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:54.210387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd878f1-ce9d-4af0-89b9-0d3a8e225c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:54.210658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd878f1-ce9d-4af0-89b9-0d3a8e225c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:54.219189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd878f1-ce9d-4af0-89b9-0d3a8e225c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:54.220645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd878f1-ce9d-4af0-89b9-0d3a8e225c33 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:54.229696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 746/1453] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:56.592508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad630-77b9-4bba-b38b-5e9739c1878d None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.593051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad630-77b9-4bba-b38b-5e9739c1878d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.593051 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad630-77b9-4bba-b38b-5e9739c1878d None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.594820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 708/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:56.600122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec0e0-3042-4257-9ddc-74b99a88e438 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.600563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec0e0-3042-4257-9ddc-74b99a88e438 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.600712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec0e0-3042-4257-9ddc-74b99a88e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.618177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-849ec0e0-3042-4257-9ddc-74b99a88e438 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:56.619365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-849ec0e0-3042-4257-9ddc-74b99a88e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:56.627183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 747/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:56.665768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dad630-77b9-4bba-b38b-5e9739c1878d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:56.676371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dad630-77b9-4bba-b38b-5e9739c1878d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:56.679833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7c5ff-fb97-4666-9506-7d81709b7505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:56.680474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7c5ff-fb97-4666-9506-7d81709b7505 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:56.680754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7c5ff-fb97-4666-9506-7d81709b7505 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:56.681023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7c5ff-fb97-4666-9506-7d81709b7505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:56.689590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7c5ff-fb97-4666-9506-7d81709b7505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:56.690993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7c5ff-fb97-4666-9506-7d81709b7505 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:56.700485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 709/1456] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:59.067866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21915d0-04ca-408b-80c0-9be628fb5f12 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.068481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21915d0-04ca-408b-80c0-9be628fb5f12 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.068481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21915d0-04ca-408b-80c0-9be628fb5f12 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.070201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 748/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:25:59.075742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62178e9-e316-4bae-8c12-006834ffaf19 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.076170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62178e9-e316-4bae-8c12-006834ffaf19 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.076303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62178e9-e316-4bae-8c12-006834ffaf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.094148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f62178e9-e316-4bae-8c12-006834ffaf19 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:25:59.095329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f62178e9-e316-4bae-8c12-006834ffaf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:59.103848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 710/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:25:59.141548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21915d0-04ca-408b-80c0-9be628fb5f12 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:59.152712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21915d0-04ca-408b-80c0-9be628fb5f12 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:59.156204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e1a3-a3dd-4d0e-bdb7-f3809ec1259f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:59.156935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e1a3-a3dd-4d0e-bdb7-f3809ec1259f service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:59.157220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e1a3-a3dd-4d0e-bdb7-f3809ec1259f service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:59.157498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e1a3-a3dd-4d0e-bdb7-f3809ec1259f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:59.166719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e1a3-a3dd-4d0e-bdb7-f3809ec1259f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:59.168162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e1a3-a3dd-4d0e-bdb7-f3809ec1259f service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:59.177487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 749/1459] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:26:01.541373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c344e1-bff9-447b-962e-ee8122e4132f None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.541944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c344e1-bff9-447b-962e-ee8122e4132f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.541944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c344e1-bff9-447b-962e-ee8122e4132f None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.543599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 711/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:01.548764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83fc1-a97e-4f35-908c-3e26054dff42 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.549179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83fc1-a97e-4f35-908c-3e26054dff42 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.549292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83fc1-a97e-4f35-908c-3e26054dff42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.566647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cea83fc1-a97e-4f35-908c-3e26054dff42 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:01.567851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cea83fc1-a97e-4f35-908c-3e26054dff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:01.575542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 750/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:01.617229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c344e1-bff9-447b-962e-ee8122e4132f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:01.627712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c344e1-bff9-447b-962e-ee8122e4132f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:01.632031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1eaaf-4516-4b1c-af5a-e30398dbc1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:01.632699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1eaaf-4516-4b1c-af5a-e30398dbc1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:01.632981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1eaaf-4516-4b1c-af5a-e30398dbc1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:01.633254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1eaaf-4516-4b1c-af5a-e30398dbc1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:01.641899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1eaaf-4516-4b1c-af5a-e30398dbc1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:01.643318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1eaaf-4516-4b1c-af5a-e30398dbc1f3 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:01.653258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 712/1462] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:03.988580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e929-fbee-4595-8647-7e874c37ad96 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.989129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e929-fbee-4595-8647-7e874c37ad96 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.989129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e929-fbee-4595-8647-7e874c37ad96 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:03.990860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 751/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:03.996206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461ad86-57e1-4f0f-86af-264b195f88fa None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:03.996647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461ad86-57e1-4f0f-86af-264b195f88fa None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:03.996793 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461ad86-57e1-4f0f-86af-264b195f88fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.014646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-0461ad86-57e1-4f0f-86af-264b195f88fa None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:04.015809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0461ad86-57e1-4f0f-86af-264b195f88fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:04.024048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 713/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:04.060786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552e929-fbee-4595-8647-7e874c37ad96 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:04.071664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552e929-fbee-4595-8647-7e874c37ad96 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:04.075196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d768c70-51c8-4bac-8f18-4764221c8c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:04.075819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768c70-51c8-4bac-8f18-4764221c8c5d service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:04.076096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768c70-51c8-4bac-8f18-4764221c8c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:04.076366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768c70-51c8-4bac-8f18-4764221c8c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:04.085707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d768c70-51c8-4bac-8f18-4764221c8c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:04.088717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d768c70-51c8-4bac-8f18-4764221c8c5d service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:04.096099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 752/1465] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:06.416099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4a35-1e8d-4e9c-bcea-2912670cc5d4 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.416695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4a35-1e8d-4e9c-bcea-2912670cc5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.416695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4a35-1e8d-4e9c-bcea-2912670cc5d4 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.418436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 714/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:06.423811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fafba-5778-4262-87f7-c0d0fc53fd95 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.424232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fafba-5778-4262-87f7-c0d0fc53fd95 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.424344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fafba-5778-4262-87f7-c0d0fc53fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.442132 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f23fafba-5778-4262-87f7-c0d0fc53fd95 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:06.443299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f23fafba-5778-4262-87f7-c0d0fc53fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:06.451364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 753/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:06.487273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4a35-1e8d-4e9c-bcea-2912670cc5d4 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:06.498231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4a35-1e8d-4e9c-bcea-2912670cc5d4 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:06.501763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a356-9107-473d-bacf-a08255d1287b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:06.502388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a356-9107-473d-bacf-a08255d1287b service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:06.502671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a356-9107-473d-bacf-a08255d1287b service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:06.502943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a356-9107-473d-bacf-a08255d1287b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:06.511922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a356-9107-473d-bacf-a08255d1287b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:06.513378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a356-9107-473d-bacf-a08255d1287b service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:06.522925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 715/1468] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:08.826937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e204c4-39e0-4c1b-ac23-a6e067130dea None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.827511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e204c4-39e0-4c1b-ac23-a6e067130dea None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.827511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e204c4-39e0-4c1b-ac23-a6e067130dea None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.829341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 754/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:08.834639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde85f-0be2-4d47-8735-7f51949683d1 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.835082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde85f-0be2-4d47-8735-7f51949683d1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.835236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde85f-0be2-4d47-8735-7f51949683d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.853248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1afde85f-0be2-4d47-8735-7f51949683d1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:08.854434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1afde85f-0be2-4d47-8735-7f51949683d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:08.862156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 716/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:08.898591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e204c4-39e0-4c1b-ac23-a6e067130dea None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:08.908990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e204c4-39e0-4c1b-ac23-a6e067130dea None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:08.912451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293c9a-6c5b-4e57-814a-212f91458e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:08.913084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293c9a-6c5b-4e57-814a-212f91458e31 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:08.913363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293c9a-6c5b-4e57-814a-212f91458e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:08.913635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293c9a-6c5b-4e57-814a-212f91458e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:08.922170 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293c9a-6c5b-4e57-814a-212f91458e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:08.923598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293c9a-6c5b-4e57-814a-212f91458e31 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:08.933215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 755/1471] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:26:29.559033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf23bbf-b01e-4894-a3d4-43814054ddb1 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.559717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf23bbf-b01e-4894-a3d4-43814054ddb1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.559717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf23bbf-b01e-4894-a3d4-43814054ddb1 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.561284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 717/1472] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:29.567123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bac4-7126-48b5-b3b2-82f891f8ca24 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.571527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bac4-7126-48b5-b3b2-82f891f8ca24 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.571527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bac4-7126-48b5-b3b2-82f891f8ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.588259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4c43bac4-7126-48b5-b3b2-82f891f8ca24 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:29.589497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4c43bac4-7126-48b5-b3b2-82f891f8ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:29.597774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 756/1473] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:26:29.643876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387ee2-a81f-436b-b49f-6424a63aa50f None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.644161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387ee2-a81f-436b-b49f-6424a63aa50f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.644446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387ee2-a81f-436b-b49f-6424a63aa50f None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.646196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 718/1474] 10.222.0.90 () {54 vars in 962 bytes} [Mon Feb 21 01:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:29.650824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd248a75-5799-4d42-bb7a-de7acd2f00ed None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.651115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd248a75-5799-4d42-bb7a-de7acd2f00ed None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.651394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd248a75-5799-4d42-bb7a-de7acd2f00ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.670150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-dd248a75-5799-4d42-bb7a-de7acd2f00ed None None] MFA Rules not processed for user `5f7d6c94406d4ae0aac5f772ff240ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:29.671412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-dd248a75-5799-4d42-bb7a-de7acd2f00ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:29.678513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 757/1475] 10.222.0.90 () {58 vars in 1059 bytes} [Mon Feb 21 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:29.685827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387ee2-a81f-436b-b49f-6424a63aa50f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:29.696016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387ee2-a81f-436b-b49f-6424a63aa50f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:29.699513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3f03-4a6a-4f01-95fc-bb893025889c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:29.700126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3f03-4a6a-4f01-95fc-bb893025889c service glance] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:29.700404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3f03-4a6a-4f01-95fc-bb893025889c service glance] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:29.700703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3f03-4a6a-4f01-95fc-bb893025889c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:29.709130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3f03-4a6a-4f01-95fc-bb893025889c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:29.710532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3f03-4a6a-4f01-95fc-bb893025889c service glance] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:29.719381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 719/1476] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:26:32.118088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03324bc-c929-4587-897e-64080a7f57f2 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:32.118633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03324bc-c929-4587-897e-64080a7f57f2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:32.118633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03324bc-c929-4587-897e-64080a7f57f2 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:32.120394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 758/1477] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:32.125682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c6f6-eb4b-4203-aaf5-d7d383449c5a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:32.126077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c6f6-eb4b-4203-aaf5-d7d383449c5a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:32.126238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c6f6-eb4b-4203-aaf5-d7d383449c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:32.144213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ec57c6f6-eb4b-4203-aaf5-d7d383449c5a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:32.145415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ec57c6f6-eb4b-4203-aaf5-d7d383449c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:32.153072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 720/1478] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:32.176539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03324bc-c929-4587-897e-64080a7f57f2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:32.188612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03324bc-c929-4587-897e-64080a7f57f2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:32.192977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7672c-b385-4f75-9e59-61ed973aa023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:32.193599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7672c-b385-4f75-9e59-61ed973aa023 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:32.193884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7672c-b385-4f75-9e59-61ed973aa023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:32.194160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7672c-b385-4f75-9e59-61ed973aa023 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:32.194886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7672c-b385-4f75-9e59-61ed973aa023 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:32.196767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7672c-b385-4f75-9e59-61ed973aa023 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:32.210510 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 759/1479] 10.222.0.90 () {56 vars in 1108 bytes} [Mon Feb 21 01:26:32 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:26:34.525746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29d1c-b52f-47f9-8bb7-a549e4bc9b44 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.526193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29d1c-b52f-47f9-8bb7-a549e4bc9b44 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.526294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29d1c-b52f-47f9-8bb7-a549e4bc9b44 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.528073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 721/1480] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:34.533266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0668-6226-4971-9e98-558826b3de37 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.533694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0668-6226-4971-9e98-558826b3de37 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.533803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0668-6226-4971-9e98-558826b3de37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.551753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-562e0668-6226-4971-9e98-558826b3de37 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:34.552974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-562e0668-6226-4971-9e98-558826b3de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:34.560665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 760/1481] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:34.601570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f29d1c-b52f-47f9-8bb7-a549e4bc9b44 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:34.616001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f29d1c-b52f-47f9-8bb7-a549e4bc9b44 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:34.621454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16e8e6-c080-4023-883c-c2d4e193c2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:34.622079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e8e6-c080-4023-883c-c2d4e193c2e2 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:34.622358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e8e6-c080-4023-883c-c2d4e193c2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:34.622630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e8e6-c080-4023-883c-c2d4e193c2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:34.631629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16e8e6-c080-4023-883c-c2d4e193c2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:34.633235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16e8e6-c080-4023-883c-c2d4e193c2e2 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:34.642926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 722/1482] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:37.119122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be1b4-a5f0-483e-8ad6-bb76378a4314 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:37.119673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be1b4-a5f0-483e-8ad6-bb76378a4314 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:37.119673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be1b4-a5f0-483e-8ad6-bb76378a4314 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:37.121531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 761/1483] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:37.126683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92787ec8-1c45-46b5-a6a3-34ac65bc976d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:37.127107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92787ec8-1c45-46b5-a6a3-34ac65bc976d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:37.127302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92787ec8-1c45-46b5-a6a3-34ac65bc976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:37.144863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-92787ec8-1c45-46b5-a6a3-34ac65bc976d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:37.146033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-92787ec8-1c45-46b5-a6a3-34ac65bc976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:37.153591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 723/1484] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:37.191612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be1b4-a5f0-483e-8ad6-bb76378a4314 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:37.202426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be1b4-a5f0-483e-8ad6-bb76378a4314 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:37.205893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9005e-6c69-4cb6-a1f5-94d29fdd703f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:37.206521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9005e-6c69-4cb6-a1f5-94d29fdd703f service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:37.206798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9005e-6c69-4cb6-a1f5-94d29fdd703f service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:37.207070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9005e-6c69-4cb6-a1f5-94d29fdd703f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:37.215710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9005e-6c69-4cb6-a1f5-94d29fdd703f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:37.217162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9005e-6c69-4cb6-a1f5-94d29fdd703f service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:37.226622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 762/1485] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:39.604507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201d43-d003-48c7-873c-87265f049ea0 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.605070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201d43-d003-48c7-873c-87265f049ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.605070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201d43-d003-48c7-873c-87265f049ea0 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.606874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 724/1486] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:39.612250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1218317-ed66-4879-a138-db52795874e7 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.612686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1218317-ed66-4879-a138-db52795874e7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.612854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1218317-ed66-4879-a138-db52795874e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.631951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e1218317-ed66-4879-a138-db52795874e7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:39.633130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e1218317-ed66-4879-a138-db52795874e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:39.640814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 763/1487] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:39.686366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201d43-d003-48c7-873c-87265f049ea0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:39.696777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201d43-d003-48c7-873c-87265f049ea0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:39.700255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dbebd-6436-4fbb-ba09-01d642f16b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:39.700973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dbebd-6436-4fbb-ba09-01d642f16b34 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:39.701253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dbebd-6436-4fbb-ba09-01d642f16b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:39.701525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dbebd-6436-4fbb-ba09-01d642f16b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:39.710607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dbebd-6436-4fbb-ba09-01d642f16b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:39.712031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dbebd-6436-4fbb-ba09-01d642f16b34 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:39.726301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 725/1488] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:42.233119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789303-8184-4cbd-b6f4-777cabd180b1 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.233690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789303-8184-4cbd-b6f4-777cabd180b1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.233690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789303-8184-4cbd-b6f4-777cabd180b1 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.235482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 764/1489] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:42.241178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60734-45ff-4308-a246-044a17adeed7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.241565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60734-45ff-4308-a246-044a17adeed7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.241727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60734-45ff-4308-a246-044a17adeed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.259032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-13f60734-45ff-4308-a246-044a17adeed7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:42.260199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-13f60734-45ff-4308-a246-044a17adeed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:42.267763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 726/1490] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:42.307601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c789303-8184-4cbd-b6f4-777cabd180b1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:42.318114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c789303-8184-4cbd-b6f4-777cabd180b1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:42.321605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc303a63-33c1-4aef-a0c4-07c4e39b3765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:42.322233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303a63-33c1-4aef-a0c4-07c4e39b3765 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:42.322518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303a63-33c1-4aef-a0c4-07c4e39b3765 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:42.322799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303a63-33c1-4aef-a0c4-07c4e39b3765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:42.331431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc303a63-33c1-4aef-a0c4-07c4e39b3765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:42.332902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc303a63-33c1-4aef-a0c4-07c4e39b3765 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:42.342310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 765/1491] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:45.105641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef962-4316-473f-8343-4ad73eaee224 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:45.106180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef962-4316-473f-8343-4ad73eaee224 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:45.106180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef962-4316-473f-8343-4ad73eaee224 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:45.107971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 727/1492] 10.222.0.90 () {54 vars in 926 bytes} [Mon Feb 21 01:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:26:45.113211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbccdf-1963-454e-b31b-5f7de0d6264b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:45.113611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbccdf-1963-454e-b31b-5f7de0d6264b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:45.113769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbccdf-1963-454e-b31b-5f7de0d6264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:45.131861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9fdbccdf-1963-454e-b31b-5f7de0d6264b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:26:45.133071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9fdbccdf-1963-454e-b31b-5f7de0d6264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:26:45.140788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 766/1493] 10.222.0.90 () {58 vars in 1023 bytes} [Mon Feb 21 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:26:45.178655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef962-4316-473f-8343-4ad73eaee224 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:45.188966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ef962-4316-473f-8343-4ad73eaee224 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:45.193305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0a0d7-52fc-433a-a8e1-985ec62de0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:45.193940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0a0d7-52fc-433a-a8e1-985ec62de0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:45.194224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0a0d7-52fc-433a-a8e1-985ec62de0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:45.194505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0a0d7-52fc-433a-a8e1-985ec62de0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:45.203266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0a0d7-52fc-433a-a8e1-985ec62de0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:45.204723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0a0d7-52fc-433a-a8e1-985ec62de0b2 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:45.214408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 728/1494] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:23.176939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.177560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.177560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.195661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:23.196881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:23.204674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 767/1495] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:23.212577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.213046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.213149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.230340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:23.231486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:23.239598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 729/1496] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:28:23.243811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.253776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cdc1-c571-4378-a625-f50cab0f058d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.258616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.259262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.259545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.259822 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.260580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:23.261003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.262611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.273583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 768/1497] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:23.281286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.298504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485b6d2-c598-46e6-bfc0-0fa13f0d6d74 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.303145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.303834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.304115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.304394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.305162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.307076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.419474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 730/1498] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:28:23 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:28:23.424250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.434171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530bb15-0afb-4714-b095-56d8a89326e2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.488882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.489545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.489831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.490110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.490804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.492786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.572279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 769/1499] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:28:23 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:28:23.577708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.587587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacb4ad-56e5-44dc-ba6b-1451fbb9c3cb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.592106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.592796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.593078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.594006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.594761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.599901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.614832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 731/1500] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:28:23.619020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.629320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df7f24-60cb-4c29-acde-a8279368be0a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.634468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ee305-2872-4ceb-99ac-3106cf3ce407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.635133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ee305-2872-4ceb-99ac-3106cf3ce407 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.635418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ee305-2872-4ceb-99ac-3106cf3ce407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.635697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ee305-2872-4ceb-99ac-3106cf3ce407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.636441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ee305-2872-4ceb-99ac-3106cf3ce407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.638106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ee305-2872-4ceb-99ac-3106cf3ce407 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.651197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 770/1501] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:28:23.655272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.665348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a118-658e-4553-b121-7e5c9108fc9b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.673927 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.674821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.675104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.675386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] PATH_INFO: `/v3/projects/050346d0f41a4bc2939096447d77cebe/users/19ee152d89db48d3a2a70ace8dcd86f4/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.689945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050346d0f41a4bc2939096447d77cebe, user_id=19ee152d89db48d3a2a70ace8dcd86f4, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.692669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.772642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 732/1502] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:28:23 2022] PUT /identity/v3/projects/050346d0f41a4bc2939096447d77cebe/users/19ee152d89db48d3a2a70ace8dcd86f4/roles/246514336b4549609174329cae41663a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:23.784168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d67c3-1010-4db8-ba55-074a6d35fb0d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.784515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d67c3-1010-4db8-ba55-074a6d35fb0d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.784799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d67c3-1010-4db8-ba55-074a6d35fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.810994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6e9d67c3-1010-4db8-ba55-074a6d35fb0d None None] MFA Rules not processed for user `19ee152d89db48d3a2a70ace8dcd86f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:23.812187 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6e9d67c3-1010-4db8-ba55-074a6d35fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:23.872249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 771/1503] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:23.883384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:23.950968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ee37-74f3-48cd-bf47-ecd7f6061a32 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:23.957470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:23.958167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:23.958477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:23.958754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:23.966612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:23.968224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:23.977309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 733/1504] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:24.043818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97130d5a-a050-4ee0-9af6-e6976a63abac None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:24.044113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97130d5a-a050-4ee0-9af6-e6976a63abac None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:24.044391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97130d5a-a050-4ee0-9af6-e6976a63abac None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:24.046223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 772/1505] 10.222.0.90 () {52 vars in 829 bytes} [Mon Feb 21 01:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:28:24.049813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:24.110031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f7fc-7f2f-4d0a-9c78-27d1d4cd3940 service nova] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:24.114507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:24.115451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:24.115725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:24.116009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] PATH_INFO: `/v3/users/19ee152d89db48d3a2a70ace8dcd86f4` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:24.117206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ee152d89db48d3a2a70ace8dcd86f4)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:24.118202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:28:24.118202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:28:24.118202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:28:24.119399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:24.335867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ee152d89db48d3a2a70ace8dcd86f4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:24.336540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ee152d89db48d3a2a70ace8dcd86f4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:24.348896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ee152d89db48d3a2a70ace8dcd86f4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:24.366213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ee152d89db48d3a2a70ace8dcd86f4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:24.366970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ee152d89db48d3a2a70ace8dcd86f4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:24.435130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 734/1506] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:28:24 2022] DELETE /identity/v3/users/19ee152d89db48d3a2a70ace8dcd86f4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:24.440179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:24.444136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:24.444136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:24.458559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:24.459735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:24.515627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 773/1507] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:24.525123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:24.526564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:24.583182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88424bd-b97c-4a14-88c1-a60448aa6763 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:24.586769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef55d5-bd9b-4ba6-94b3-0b4bebb2b1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:24.587343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef55d5-bd9b-4ba6-94b3-0b4bebb2b1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:24.587620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef55d5-bd9b-4ba6-94b3-0b4bebb2b1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:24.587892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef55d5-bd9b-4ba6-94b3-0b4bebb2b1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:24.597054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef55d5-bd9b-4ba6-94b3-0b4bebb2b1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:24.598686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef55d5-bd9b-4ba6-94b3-0b4bebb2b1d8 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:24.607574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 735/1508] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:25.045470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:25.047581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:25.059246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f431479-9791-45f8-8108-45ce17766f87 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:25.064060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:25.064943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:25.065229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:25.065509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] PATH_INFO: `/v3/projects/050346d0f41a4bc2939096447d77cebe` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:25.066697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=050346d0f41a4bc2939096447d77cebe)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:25.067805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:28:25.067805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:28:25.067805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:28:25.072475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:25.217057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050346d0f41a4bc2939096447d77cebe', 'request_id': 'req-039acb95-d6a6-4d9b-9d66-091cf95ae95c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:25.289640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050346d0f41a4bc2939096447d77cebe', 'request_id': 'req-039acb95-d6a6-4d9b-9d66-091cf95ae95c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:25.303153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050346d0f41a4bc2939096447d77cebe', 'request_id': 'req-039acb95-d6a6-4d9b-9d66-091cf95ae95c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:25.313662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] The token cache is being invalidate because project 050346d0f41a4bc2939096447d77cebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:28:25.313944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:25.314743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-039acb95-d6a6-4d9b-9d66-091cf95ae95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:25.316322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 774/1509] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:28:25 2022] DELETE /identity/v3/projects/050346d0f41a4bc2939096447d77cebe => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:30:01.664408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb66-4c37-44d0-9972-a84bd613a12e None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.664942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb66-4c37-44d0-9972-a84bd613a12e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.665041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb66-4c37-44d0-9972-a84bd613a12e None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.666781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 736/1510] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:01.671647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcd334-bc16-469e-ba72-73f38cacc2ce None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.672156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcd334-bc16-469e-ba72-73f38cacc2ce None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.672262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcd334-bc16-469e-ba72-73f38cacc2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.691677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-bcfcd334-bc16-469e-ba72-73f38cacc2ce None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:01.692977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bcfcd334-bc16-469e-ba72-73f38cacc2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.752314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 775/1511] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:01.908647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb66-4c37-44d0-9972-a84bd613a12e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:01.910290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-eef9bb66-4c37-44d0-9972-a84bd613a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.981404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb66-4c37-44d0-9972-a84bd613a12e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:01.987333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fab65a-ff6b-4202-860b-261efc8751e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:01.987964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fab65a-ff6b-4202-860b-261efc8751e1 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.988250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fab65a-ff6b-4202-860b-261efc8751e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.988560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fab65a-ff6b-4202-860b-261efc8751e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.996372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fab65a-ff6b-4202-860b-261efc8751e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:01.997988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fab65a-ff6b-4202-860b-261efc8751e1 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:02.007334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 737/1512] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:02.529322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f324-d462-4274-9194-0120223ace73 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:02.529746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f324-d462-4274-9194-0120223ace73 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:02.530032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f324-d462-4274-9194-0120223ace73 None None] PATH_INFO: `/v3` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:02.531345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 776/1513] 10.222.0.43 () {54 vars in 925 bytes} [Mon Feb 21 01:30:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:30:02.537669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046045af-f679-41a4-aca2-94c55e82d9eb None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:02.537958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046045af-f679-41a4-aca2-94c55e82d9eb None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:02.538235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046045af-f679-41a4-aca2-94c55e82d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:02.556727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-046045af-f679-41a4-aca2-94c55e82d9eb None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:02.557916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-046045af-f679-41a4-aca2-94c55e82d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:02.622042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 738/1514] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Feb 21 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:03.281696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a3ae-e676-4dde-a0d3-87d348d825ad None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:03.282262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a3ae-e676-4dde-a0d3-87d348d825ad None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:03.282262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a3ae-e676-4dde-a0d3-87d348d825ad None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:03.284755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 777/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:03.289728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d543a-b02e-4825-8149-97d81ebf3301 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:03.290148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d543a-b02e-4825-8149-97d81ebf3301 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:03.290292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d543a-b02e-4825-8149-97d81ebf3301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:03.307832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b05d543a-b02e-4825-8149-97d81ebf3301 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:03.309039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b05d543a-b02e-4825-8149-97d81ebf3301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:03.316700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 739/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:03.469458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a3ae-e676-4dde-a0d3-87d348d825ad None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:03.483697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a3ae-e676-4dde-a0d3-87d348d825ad None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:03.489179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac10cc-d1ac-44d8-b047-98153007b78a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:03.489807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac10cc-d1ac-44d8-b047-98153007b78a service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:03.490092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac10cc-d1ac-44d8-b047-98153007b78a service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:03.490371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac10cc-d1ac-44d8-b047-98153007b78a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:03.498394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac10cc-d1ac-44d8-b047-98153007b78a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:03.500048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac10cc-d1ac-44d8-b047-98153007b78a service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:03.510243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 778/1517] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:06.823509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fef51-02d9-4e57-a210-aa6917bda843 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:06.824062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fef51-02d9-4e57-a210-aa6917bda843 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:06.824062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fef51-02d9-4e57-a210-aa6917bda843 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:06.825859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 740/1518] 10.222.0.90 () {54 vars in 960 bytes} [Mon Feb 21 01:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:06.831666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172014d-4d9d-406c-9a27-9e0cfa801f24 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:06.832090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172014d-4d9d-406c-9a27-9e0cfa801f24 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:06.832218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172014d-4d9d-406c-9a27-9e0cfa801f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:06.850657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-d172014d-4d9d-406c-9a27-9e0cfa801f24 None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:06.851853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d172014d-4d9d-406c-9a27-9e0cfa801f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:06.860455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 779/1519] 10.222.0.90 () {58 vars in 1057 bytes} [Mon Feb 21 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:06.868011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fef51-02d9-4e57-a210-aa6917bda843 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:06.883279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fef51-02d9-4e57-a210-aa6917bda843 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:06.890251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a13947-59d8-4080-acc2-f92a7ab18516 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:06.890251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a13947-59d8-4080-acc2-f92a7ab18516 service placement] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:06.890251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a13947-59d8-4080-acc2-f92a7ab18516 service placement] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:06.890251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a13947-59d8-4080-acc2-f92a7ab18516 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:06.901471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a13947-59d8-4080-acc2-f92a7ab18516 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:06.902471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a13947-59d8-4080-acc2-f92a7ab18516 service placement] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:06.912412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 741/1520] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:15.200190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ac47-ec4f-4618-8794-b246735a245a None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:15.200783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ac47-ec4f-4618-8794-b246735a245a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:15.200783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ac47-ec4f-4618-8794-b246735a245a None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:15.202561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 780/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:15.207526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433302-8b63-4ba5-ab66-54b393effa00 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:15.207934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433302-8b63-4ba5-ab66-54b393effa00 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:15.208081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433302-8b63-4ba5-ab66-54b393effa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:15.227526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-34433302-8b63-4ba5-ab66-54b393effa00 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:15.228741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-34433302-8b63-4ba5-ab66-54b393effa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:15.236967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 742/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:15.390624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541ac47-ec4f-4618-8794-b246735a245a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:15.404699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541ac47-ec4f-4618-8794-b246735a245a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:15.410593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc580fb4-a963-4b2f-8817-2591973b8047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:15.411220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc580fb4-a963-4b2f-8817-2591973b8047 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:15.411505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc580fb4-a963-4b2f-8817-2591973b8047 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:15.411779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc580fb4-a963-4b2f-8817-2591973b8047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:15.419559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc580fb4-a963-4b2f-8817-2591973b8047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:15.421193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc580fb4-a963-4b2f-8817-2591973b8047 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:15.430884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 781/1523] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:16.711761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376d6b5-8d96-438b-a91c-9d9a83c8c9e0 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:16.712286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376d6b5-8d96-438b-a91c-9d9a83c8c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:16.712286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376d6b5-8d96-438b-a91c-9d9a83c8c9e0 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:16.714091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 743/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:16.718935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062a13-3ba9-4ff9-8d30-739093121992 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:16.719331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062a13-3ba9-4ff9-8d30-739093121992 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:16.720231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062a13-3ba9-4ff9-8d30-739093121992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:16.737962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4d062a13-3ba9-4ff9-8d30-739093121992 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:16.739138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4d062a13-3ba9-4ff9-8d30-739093121992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:16.747055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 782/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:16.902259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376d6b5-8d96-438b-a91c-9d9a83c8c9e0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:16.917348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376d6b5-8d96-438b-a91c-9d9a83c8c9e0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:16.923766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e19f-b4c0-4b5c-abdf-7832bb080df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:16.924410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e19f-b4c0-4b5c-abdf-7832bb080df2 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:16.924722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e19f-b4c0-4b5c-abdf-7832bb080df2 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:16.924999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e19f-b4c0-4b5c-abdf-7832bb080df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:16.937489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e19f-b4c0-4b5c-abdf-7832bb080df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:16.937489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e19f-b4c0-4b5c-abdf-7832bb080df2 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:16.951440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 744/1526] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:21.200645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d9d1-d75c-4598-9116-fb0fb1591bf3 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:21.201188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d9d1-d75c-4598-9116-fb0fb1591bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:21.201188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d9d1-d75c-4598-9116-fb0fb1591bf3 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:21.202981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 783/1527] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:21.208145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580d85-98ee-454d-9184-16dc513be12b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:21.208581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580d85-98ee-454d-9184-16dc513be12b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:21.208732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580d85-98ee-454d-9184-16dc513be12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:21.226020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-67580d85-98ee-454d-9184-16dc513be12b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:21.227179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-67580d85-98ee-454d-9184-16dc513be12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:21.234727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 745/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:30:21.271278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d9d1-d75c-4598-9116-fb0fb1591bf3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:21.273061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e892d9d1-d75c-4598-9116-fb0fb1591bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:21.328078 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d9d1-d75c-4598-9116-fb0fb1591bf3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:21.331578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc64a96-3a86-4ca0-9a26-980e73a0e25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:21.332208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64a96-3a86-4ca0-9a26-980e73a0e25c service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:21.332528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64a96-3a86-4ca0-9a26-980e73a0e25c service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:21.332809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64a96-3a86-4ca0-9a26-980e73a0e25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:21.341356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc64a96-3a86-4ca0-9a26-980e73a0e25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:21.343070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc64a96-3a86-4ca0-9a26-980e73a0e25c service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:21.352585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 784/1529] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:23.662689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecda62-0573-43a8-8302-46a0a834c5da None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:23.663211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecda62-0573-43a8-8302-46a0a834c5da None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:23.663211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecda62-0573-43a8-8302-46a0a834c5da None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:23.665044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 746/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:23.670135 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce3e75-3f30-4d22-9fa7-c88478c3831c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:23.670565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce3e75-3f30-4d22-9fa7-c88478c3831c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:23.670680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce3e75-3f30-4d22-9fa7-c88478c3831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:23.690640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-78ce3e75-3f30-4d22-9fa7-c88478c3831c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:23.691851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-78ce3e75-3f30-4d22-9fa7-c88478c3831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:23.699434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 785/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:23.736372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecda62-0573-43a8-8302-46a0a834c5da None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:23.746722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecda62-0573-43a8-8302-46a0a834c5da None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:23.750168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e0bf-8a55-4162-a255-190f2accebbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:23.750869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e0bf-8a55-4162-a255-190f2accebbb service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:23.751145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e0bf-8a55-4162-a255-190f2accebbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:23.751414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e0bf-8a55-4162-a255-190f2accebbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:23.760137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e0bf-8a55-4162-a255-190f2accebbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:23.761590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e0bf-8a55-4162-a255-190f2accebbb service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:23.770441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 747/1532] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:27.740277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf135-3c0d-49e1-b8d7-c084a7643662 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:27.740880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf135-3c0d-49e1-b8d7-c084a7643662 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:27.740880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf135-3c0d-49e1-b8d7-c084a7643662 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:27.742660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 786/1533] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:27.748016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614a36-d84a-4a40-96b8-28fe2acd913e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:27.748541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614a36-d84a-4a40-96b8-28fe2acd913e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:27.748653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614a36-d84a-4a40-96b8-28fe2acd913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:27.767412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-c9614a36-d84a-4a40-96b8-28fe2acd913e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:27.768635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c9614a36-d84a-4a40-96b8-28fe2acd913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:27.776912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 748/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:28.035073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf135-3c0d-49e1-b8d7-c084a7643662 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:28.036882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1f7bf135-3c0d-49e1-b8d7-c084a7643662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:28.094000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf135-3c0d-49e1-b8d7-c084a7643662 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:28.098304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a709a2-8910-4bbf-b112-59b92619ce87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:28.098947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a709a2-8910-4bbf-b112-59b92619ce87 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:28.099236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a709a2-8910-4bbf-b112-59b92619ce87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:28.099511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a709a2-8910-4bbf-b112-59b92619ce87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:28.108760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a709a2-8910-4bbf-b112-59b92619ce87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:28.110203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a709a2-8910-4bbf-b112-59b92619ce87 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:28.119733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 787/1535] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:30.486768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337565b-b15a-442b-89c1-baf9987eee87 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.487351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337565b-b15a-442b-89c1-baf9987eee87 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.487351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337565b-b15a-442b-89c1-baf9987eee87 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.489151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 749/1536] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:30.494681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf7ec8-d936-4b53-823d-40cae6b5851b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.495129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf7ec8-d936-4b53-823d-40cae6b5851b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.495241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf7ec8-d936-4b53-823d-40cae6b5851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.513507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9cbf7ec8-d936-4b53-823d-40cae6b5851b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:30.514726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9cbf7ec8-d936-4b53-823d-40cae6b5851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:30.523073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 788/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:30.777694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05e97-0f40-4d8a-8b89-84692d6c6a8c None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.777914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05e97-0f40-4d8a-8b89-84692d6c6a8c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.778197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05e97-0f40-4d8a-8b89-84692d6c6a8c None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.780219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 750/1538] 10.222.0.90 () {54 vars in 963 bytes} [Mon Feb 21 01:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:30:30.785654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70fc9a-1e83-4d9c-8902-2c081887bf46 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.785950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70fc9a-1e83-4d9c-8902-2c081887bf46 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.786229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70fc9a-1e83-4d9c-8902-2c081887bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.804849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1c70fc9a-1e83-4d9c-8902-2c081887bf46 None None] MFA Rules not processed for user `89e39e92f70b45e39ae07a123beff178`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:30:30.806040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1c70fc9a-1e83-4d9c-8902-2c081887bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:30.812835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 789/1539] 10.222.0.90 () {58 vars in 1060 bytes} [Mon Feb 21 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:30.820268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05e97-0f40-4d8a-8b89-84692d6c6a8c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:30.831914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05e97-0f40-4d8a-8b89-84692d6c6a8c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:30.835516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c50a-1ddc-4bcd-873f-c438599fe69d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:30.836146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c50a-1ddc-4bcd-873f-c438599fe69d service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:30.836495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c50a-1ddc-4bcd-873f-c438599fe69d service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:30.836735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c50a-1ddc-4bcd-873f-c438599fe69d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:30.846552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c50a-1ddc-4bcd-873f-c438599fe69d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:30.848001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c50a-1ddc-4bcd-873f-c438599fe69d service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:30.859082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 751/1540] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:55.314596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.315637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.316093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.338316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:55.339501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:55.349372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 790/1541] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:55.358222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.358769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.358769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.380778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:55.382208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:55.395742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 752/1542] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:55.400168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:55.410084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af059c-2af9-472b-add2-9ce3073a5bce None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:55.417704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:55.418372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.418652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.418922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.419646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:55.419947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:55.422125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:55.434477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 791/1543] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:55.443038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:55.455863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5823a7-85c0-482c-9011-a3387a3e0a74 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:55.466097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:55.466757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.467032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.467334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.468231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:55.470187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:55.595091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 753/1544] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:55 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:55.599244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:55.616313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652edb-7a17-4af2-9e15-0a7e08a4669a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:55.763763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:55.764516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.764803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.765080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.765794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:55.767744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:55.876592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 792/1545] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:55 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:55.881000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:55.898015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66294eb-26d9-4d0c-8740-0f0b8a407ef4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:55.906556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:55.907238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.907515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.907789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.908559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:55.910165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:55.931084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 754/1546] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:55.935075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:55.949950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e68ce-9ebb-4055-b4c9-8ca8be7e7c13 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:55.954908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc93cf5-9b90-48f1-b0b1-1f63978011c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:55.955593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc93cf5-9b90-48f1-b0b1-1f63978011c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.956017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc93cf5-9b90-48f1-b0b1-1f63978011c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.956300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc93cf5-9b90-48f1-b0b1-1f63978011c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:55.957182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc93cf5-9b90-48f1-b0b1-1f63978011c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:55.958821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc93cf5-9b90-48f1-b0b1-1f63978011c4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:55.975431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 793/1547] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:55.979906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:55.991631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246fb7-b709-44b8-90fe-f475b3529163 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:55.998394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0fd7b-2515-4607-857d-daee9df36a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:55.999372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fd7b-2515-4607-857d-daee9df36a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:55.999649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fd7b-2515-4607-857d-daee9df36a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:55.999923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fd7b-2515-4607-857d-daee9df36a8d admin admin] PATH_INFO: `/v3/projects/a2fb11bd56f946d1a12bb7aba48aece1/users/210676a641554f6e816dda2a7717cbc4/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.008608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195d7a-90a7-4067-9500-153d7e715889 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.008934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195d7a-90a7-4067-9500-153d7e715889 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.009169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195d7a-90a7-4067-9500-153d7e715889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.040760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6f195d7a-90a7-4067-9500-153d7e715889 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.042363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6f195d7a-90a7-4067-9500-153d7e715889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.048337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0fd7b-2515-4607-857d-daee9df36a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fb11bd56f946d1a12bb7aba48aece1, user_id=210676a641554f6e816dda2a7717cbc4, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.055495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0fd7b-2515-4607-857d-daee9df36a8d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.066181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 794/1548] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.067514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cadbb-d9be-4088-baf9-310f6459db5e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.067953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cadbb-d9be-4088-baf9-310f6459db5e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.068239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cadbb-d9be-4088-baf9-310f6459db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.091333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-487cadbb-d9be-4088-baf9-310f6459db5e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.093289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-487cadbb-d9be-4088-baf9-310f6459db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.104724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 795/1549] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.105853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64a95f-0343-46f3-b0fa-539f1a80d374 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.106143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64a95f-0343-46f3-b0fa-539f1a80d374 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.106421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64a95f-0343-46f3-b0fa-539f1a80d374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.130274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cb64a95f-0343-46f3-b0fa-539f1a80d374 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.131390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cb64a95f-0343-46f3-b0fa-539f1a80d374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.147910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 755/1550] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:55 2022] PUT /identity/v3/projects/a2fb11bd56f946d1a12bb7aba48aece1/users/210676a641554f6e816dda2a7717cbc4/roles/246514336b4549609174329cae41663a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:56.150117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829a1e9-437c-4ce0-8e7c-dfc3f5a51bf3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.150662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829a1e9-437c-4ce0-8e7c-dfc3f5a51bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.152505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829a1e9-437c-4ce0-8e7c-dfc3f5a51bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.157252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 796/1551] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.159591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9604a-ac3a-4ece-8efe-660ec6a2e775 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.163063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9604a-ac3a-4ece-8efe-660ec6a2e775 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.171609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9604a-ac3a-4ece-8efe-660ec6a2e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.196066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3829a1e9-437c-4ce0-8e7c-dfc3f5a51bf3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.198132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3829a1e9-437c-4ce0-8e7c-dfc3f5a51bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.201151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e8d9604a-ac3a-4ece-8efe-660ec6a2e775 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.202915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e8d9604a-ac3a-4ece-8efe-660ec6a2e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.271136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 797/1552] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.272021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 756/1553] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.272469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628877ab-3718-43a8-b7c7-d3861974733c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.272759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628877ab-3718-43a8-b7c7-d3861974733c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.273035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628877ab-3718-43a8-b7c7-d3861974733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.273624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.274037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.274317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.291930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.292148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-628877ab-3718-43a8-b7c7-d3861974733c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.293139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.293343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-628877ab-3718-43a8-b7c7-d3861974733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.300475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 757/1554] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.301301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.301875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 798/1555] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.303329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5425b3-b5ee-4013-92a5-f96bdf910997 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.303858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5425b3-b5ee-4013-92a5-f96bdf910997 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.304750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5425b3-b5ee-4013-92a5-f96bdf910997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.311386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfe0e6-af74-4ebf-9ab8-ace7669fa4bf None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.315888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.316562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.316844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.317117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.317857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.318158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.319749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845ff8-0b4d-4460-bea2-bcbbf3535fd0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.323956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8e5425b3-b5ee-4013-92a5-f96bdf910997 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.325178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8e5425b3-b5ee-4013-92a5-f96bdf910997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.331766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 758/1556] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.333076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.333366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.339460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 799/1557] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.339620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.339707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee46-3883-40d2-859e-8687ca37a0b1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.339707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee46-3883-40d2-859e-8687ca37a0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.339707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee46-3883-40d2-859e-8687ca37a0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.356546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.357083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-80f1ee46-3883-40d2-859e-8687ca37a0b1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.357725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.358255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-80f1ee46-3883-40d2-859e-8687ca37a0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.365482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 759/1558] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.366497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.366632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 800/1559] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.367573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2146-e5da-4f55-aa28-53194f55eabc None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.367862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2146-e5da-4f55-aa28-53194f55eabc None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.368173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2146-e5da-4f55-aa28-53194f55eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.382193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825142-875d-44b2-a1c8-2c89e51c563a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.386699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.387347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.387626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.387898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.388673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.388978 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.389865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-d44b2146-e5da-4f55-aa28-53194f55eabc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.391021 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d44b2146-e5da-4f55-aa28-53194f55eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.391121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.398727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 801/1560] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.399990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.400291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.400572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.402356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 760/1561] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.403141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.420918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.422128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.429890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 802/1562] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.430627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.439493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63bf9d-2d3c-431a-af97-b6f1252c5164 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.444010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.444671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.445029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.445217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.445891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.447818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.454909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca967b5d-0641-46d8-a2bb-4e99253d02c6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.458497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394cc19-c33e-48ee-99f0-fec0c3816f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.459136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394cc19-c33e-48ee-99f0-fec0c3816f36 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.459416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394cc19-c33e-48ee-99f0-fec0c3816f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.459691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394cc19-c33e-48ee-99f0-fec0c3816f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.469083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394cc19-c33e-48ee-99f0-fec0c3816f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.470508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394cc19-c33e-48ee-99f0-fec0c3816f36 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.479520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 761/1563] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:56.480830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615012b-9af8-4d6d-9b6f-d68e5bb60eea None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.481120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615012b-9af8-4d6d-9b6f-d68e5bb60eea None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.481393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615012b-9af8-4d6d-9b6f-d68e5bb60eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.498918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9615012b-9af8-4d6d-9b6f-d68e5bb60eea None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.500120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9615012b-9af8-4d6d-9b6f-d68e5bb60eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.508296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 762/1564] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.509614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e045b9-697d-4db6-8e91-326102417298 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.509902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e045b9-697d-4db6-8e91-326102417298 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.510178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e045b9-697d-4db6-8e91-326102417298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.527620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e0e045b9-697d-4db6-8e91-326102417298 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.528803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e0e045b9-697d-4db6-8e91-326102417298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.536982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 763/1565] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.538144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.538434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.538708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.557067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:56.558222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:56.566485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 764/1566] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:56.567223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.573743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 803/1567] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:56.573743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.576151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125e22a-5675-41ac-8ae5-d3104d22a25c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.633601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.634189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.634470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.634742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.635456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.635749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.637369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.639128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5275ec-c93b-46ff-9cd1-39a0d39ca2a8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.644027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.644733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.645001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.645410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.646147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.648127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.649688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 765/1568] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.650415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.660608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7e3b9-c6fa-43ff-9f54-752bcdf74492 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.665424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.666043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.666322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.666593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.667413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.667587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.669222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.682562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 766/1569] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.683408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.694408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b947c3-96fb-4616-8295-182db2e8edd6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.699119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.701429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.701429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.701429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.701429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.701429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.702956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.714012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 767/1570] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.714790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.724783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a06fab-53da-4a9a-a5ec-7aec4ae82209 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.729522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.730136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.730416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.730684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.731430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.731758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.733976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.745489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 768/1571] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.746339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.755960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 804/1572] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:56.755960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.759431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79867d8-ee18-477f-b038-08c705b799c7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.814872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c52e4c-b79c-4185-84e6-5d08f417423f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.823152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.823750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.824661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.824950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.825476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.825951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.826076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.827045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.828217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.828310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.828911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:31:56.829336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.831920 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.845772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 769/1573] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:31:56.853830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.864361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a2176-dafc-4da8-9abc-443463369bd7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.869017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.870714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.870714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.870714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.871017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.872910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.916182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 805/1574] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:56.918434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:56.928588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e607e56-1e88-472b-9015-04c929045684 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:56.933211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:56.933842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:56.934123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:56.934398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:56.935115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:56.937108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:56.962790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 770/1575] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:56.963591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.014763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 806/1576] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.015993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.025859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5245dc-d5df-4874-8e2f-6a01affe9255 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.088654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaf09e-8437-4aed-9488-f5e7d9ea1ffc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.088803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.088803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.088803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.088803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.089101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.089869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.089975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.090596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.090878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.091152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.091841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.094495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.175037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 807/1577] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.175906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.185402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0792b-86c4-4b16-afbe-8bb37705b5a4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.191985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.191985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.191985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.191985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.192375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.193845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.223061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 771/1578] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.223858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.285245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3785-a772-4f88-b4c5-6f8d72d7ba97 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.290092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.295192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.295192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.295192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.295192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.295192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.296115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 808/1579] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.297593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.365367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea445ea1-630d-4faf-aeba-2d9ef1e4f420 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.370346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.371015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.371298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.371651 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.372485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.374749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.385339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 809/1580] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.390193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 772/1581] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.390699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.390793 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.399896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afc389-cbb1-4505-96e4-d2bc886b265c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.447824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f56997-ca1b-479e-a467-49ed2890a02f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.453510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.454497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.454618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.454846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.455562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.455964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.456672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.456959 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.457237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.457512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.457944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.460119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.567808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 773/1582] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.568786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.578701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396054b-8a9f-4ddb-bcc4-679c0dc15c89 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.583204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.583834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.584121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.584399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.585177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.589791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.593086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 810/1583] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.593748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.600507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 774/1584] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.601250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.603743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31d3d3-e43c-4314-8711-402c1f2356c1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.608557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.609206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.609489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.609767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.610480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.610901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e9df-d97d-47f3-a289-f3aa2978c546 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.612480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.616118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.616964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.619165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.619165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.619165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.620276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.715588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 775/1585] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.720046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 811/1586] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.720046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.720271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.728836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587ab60-cf90-47c7-a20d-d0f1156495df admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.729367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bc8cf-419a-46e6-9d1a-bc30ab7bbf87 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.734154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.734590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.734896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.735247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.735369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.735526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.735708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.735817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.736660 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.736779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.738297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.738828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.751841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 776/1587] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.753075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.763367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1460f-6e65-4d70-a1f9-ffdc0d2532be admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.780097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.780883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.781178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.781452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.782186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.783802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.802941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 777/1588] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.802941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.810962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f8579-9685-4fe3-a3eb-2e697d610a9e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.816221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.816896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.817179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.817450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.818269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.819886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.830059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 778/1589] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.830948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.832989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 812/1590] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:57.834045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.844511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51bbc-2074-44b3-9e99-b365521ff98a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.844846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd9710-0cde-4344-ac45-6c7f686d7630 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.849967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.850125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.850664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.850946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.851222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.851405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.851689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.851965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.852075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.852734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.853696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.854619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.865939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 779/1591] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.866756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.871939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 813/1592] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.871939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.877271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865849-de0d-41ae-bc30-c3bc38b68059 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.880800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae497-4ff0-4fd0-96a2-0bb6f43d1f57 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:57.882291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f2d64-c9dd-427d-a6b7-b3f2667bd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.882945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f2d64-c9dd-427d-a6b7-b3f2667bd3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.883225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f2d64-c9dd-427d-a6b7-b3f2667bd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.883492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f2d64-c9dd-427d-a6b7-b3f2667bd3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.884207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f2d64-c9dd-427d-a6b7-b3f2667bd3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.885824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f2d64-c9dd-427d-a6b7-b3f2667bd3ce admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.886099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:57.886972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.887256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.887640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] PATH_INFO: `/v3/projects/d3acaa73503748ac9764a7eca8943882/users/ab38a084fbb643298d38c4cd8dcf87cd/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.896646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 780/1593] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:57.898130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:57.898492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:57.898968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:57.904107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3acaa73503748ac9764a7eca8943882, user_id=ab38a084fbb643298d38c4cd8dcf87cd, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:57.906847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:57.924548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] MFA Rules not processed for user `210676a641554f6e816dda2a7717cbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:57.925727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:57.986666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 781/1594] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:57.987549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:57.997388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bf7e4-d810-472f-8201-a2a5ed0ff7ec None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.004072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 814/1595] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:57 2022] PUT /identity/v3/projects/d3acaa73503748ac9764a7eca8943882/users/ab38a084fbb643298d38c4cd8dcf87cd/roles/246514336b4549609174329cae41663a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.005161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.050792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.051454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.051734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.052008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.052764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.054317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.064132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 782/1596] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:58.064945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.065525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617d9c-9c40-4b2e-89c4-5260cdbe2bbe admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.071663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.072523 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.072812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.073089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.073810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.074206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91ffc6-1872-4016-8cfe-0a1d79c5bb25 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.075412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.078807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.079455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.079733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.080003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.080724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.082296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.088197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 815/1597] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:58.088197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.094974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 783/1598] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:58.094974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.099974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61db52-daa8-4d99-9c29-19833c5915f3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.101734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a9bc-0286-4638-9cb7-f65c16db60c0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.104642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eab7c-3919-4780-9fec-b510d6c50b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.105507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eab7c-3919-4780-9fec-b510d6c50b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.105791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eab7c-3919-4780-9fec-b510d6c50b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.106063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eab7c-3919-4780-9fec-b510d6c50b9d admin admin] PATH_INFO: `/v3/projects/fa11c817930e42c49bb0f242205952d7/users/f213f03b8c094202b25d6a1fcccb5994/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.106283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.106895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.107170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.107443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.108781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.110331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.120229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 784/1599] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:58.121035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.121138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eab7c-3919-4780-9fec-b510d6c50b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa11c817930e42c49bb0f242205952d7, user_id=f213f03b8c094202b25d6a1fcccb5994, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.123963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eab7c-3919-4780-9fec-b510d6c50b9d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.129878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ffd1-f2b1-4088-89f9-6578af7819d4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.134686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538b49-15f5-4b22-87cb-27ad6f51c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.138792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538b49-15f5-4b22-87cb-27ad6f51c0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.138792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538b49-15f5-4b22-87cb-27ad6f51c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.138792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538b49-15f5-4b22-87cb-27ad6f51c0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.138792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86538b49-15f5-4b22-87cb-27ad6f51c0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.138792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86538b49-15f5-4b22-87cb-27ad6f51c0ad admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.147922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 785/1600] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:58.149329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.149618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.149884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.168361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] MFA Rules not processed for user `210676a641554f6e816dda2a7717cbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.169560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.191926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 816/1601] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:58 2022] PUT /identity/v3/projects/fa11c817930e42c49bb0f242205952d7/users/f213f03b8c094202b25d6a1fcccb5994/roles/246514336b4549609174329cae41663a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.193436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.193790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.194536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.211080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.212272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.222656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 786/1602] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.227079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.247608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa572-bef1-4b88-9f26-2503f15c7d16 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.271069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 817/1603] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.271989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.283594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5c678-fcd1-4c9a-962b-15b920e8332a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.288156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.289056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.289357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.289616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] PATH_INFO: `/v3/projects/bcd999dab8754ac6b709236c3d74eada/users/d7b26021eb6143adb28da194f2d10b1e/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.292703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.293581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.293855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.294123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] PATH_INFO: `/v3/projects/78eb2e61f0d645fa999107e9c19a93a6/users/2047e91616814436939d27f4fa9ed5b8/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.304324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd999dab8754ac6b709236c3d74eada, user_id=d7b26021eb6143adb28da194f2d10b1e, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.307033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.308481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78eb2e61f0d645fa999107e9c19a93a6, user_id=2047e91616814436939d27f4fa9ed5b8, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.311168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.395759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 818/1604] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:58 2022] PUT /identity/v3/projects/bcd999dab8754ac6b709236c3d74eada/users/d7b26021eb6143adb28da194f2d10b1e/roles/246514336b4549609174329cae41663a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.397466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.403419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 787/1605] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:58 2022] PUT /identity/v3/projects/78eb2e61f0d645fa999107e9c19a93a6/users/2047e91616814436939d27f4fa9ed5b8/roles/246514336b4549609174329cae41663a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.405348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.458362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ddf29-98b8-4adb-b2e9-5697fda947dc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.463153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.463816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.464102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.464381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.464949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a9326-b01f-400c-a9ad-9d314b59d410 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.465137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.466745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.470210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2bfb-4eed-44ca-871e-b6433102b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.471087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2bfb-4eed-44ca-871e-b6433102b70c admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.471530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2bfb-4eed-44ca-871e-b6433102b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.471745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2bfb-4eed-44ca-871e-b6433102b70c admin admin] PATH_INFO: `/v3/projects/b08ce2fecf1244daa2530b60e3010c19/users/a0fb5c73c3c9411fa500edac52319899/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.476969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 819/1606] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:58.480283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.485958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc2bfb-4eed-44ca-871e-b6433102b70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08ce2fecf1244daa2530b60e3010c19, user_id=a0fb5c73c3c9411fa500edac52319899, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.487260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23044816-cc35-456f-bb86-43334aab6a84 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.488669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc2bfb-4eed-44ca-871e-b6433102b70c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.491840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f560ce-d865-4f94-a70e-54c8af1fef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.492732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f560ce-d865-4f94-a70e-54c8af1fef26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.493021 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f560ce-d865-4f94-a70e-54c8af1fef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.493298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f560ce-d865-4f94-a70e-54c8af1fef26 admin admin] PATH_INFO: `/v3/projects/11d99a6bb8ad42a980e51a57fcec7315/users/35d4828335a543758d1413c0276657a6/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.507608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f560ce-d865-4f94-a70e-54c8af1fef26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d99a6bb8ad42a980e51a57fcec7315, user_id=35d4828335a543758d1413c0276657a6, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.510259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f560ce-d865-4f94-a70e-54c8af1fef26 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.591902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 788/1607] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:58 2022] PUT /identity/v3/projects/b08ce2fecf1244daa2530b60e3010c19/users/a0fb5c73c3c9411fa500edac52319899/roles/246514336b4549609174329cae41663a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.593880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c1f02-cea1-4fc9-9034-235e7ce39e7b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.594169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c1f02-cea1-4fc9-9034-235e7ce39e7b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.594446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c1f02-cea1-4fc9-9034-235e7ce39e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.607588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 820/1608] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:58 2022] PUT /identity/v3/projects/11d99a6bb8ad42a980e51a57fcec7315/users/35d4828335a543758d1413c0276657a6/roles/246514336b4549609174329cae41663a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.609103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3f6a-333b-4e54-bbaf-e11bfa5d3255 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.609392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3f6a-333b-4e54-bbaf-e11bfa5d3255 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.609669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3f6a-333b-4e54-bbaf-e11bfa5d3255 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.611327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-040c1f02-cea1-4fc9-9034-235e7ce39e7b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.611452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 821/1609] 10.222.0.90 () {54 vars in 961 bytes} [Mon Feb 21 01:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:58.615514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f3f6a-333b-4e54-bbaf-e11bfa5d3255 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.615652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-040c1f02-cea1-4fc9-9034-235e7ce39e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.618337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a13f3f6a-333b-4e54-bbaf-e11bfa5d3255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.673064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 789/1610] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.673064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.673064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.673064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.684907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f3f6a-333b-4e54-bbaf-e11bfa5d3255 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.688779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307d43a-4f73-449f-8abc-338895c647b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.689431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307d43a-4f73-449f-8abc-338895c647b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.689715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307d43a-4f73-449f-8abc-338895c647b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.689992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307d43a-4f73-449f-8abc-338895c647b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.699066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] MFA Rules not processed for user `d7b26021eb6143adb28da194f2d10b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.699227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307d43a-4f73-449f-8abc-338895c647b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.700266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.700548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307d43a-4f73-449f-8abc-338895c647b4 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.710636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 822/1611] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:58.712075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d364c-98c7-4171-8781-d530411a0a96 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.712376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d364c-98c7-4171-8781-d530411a0a96 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.712683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d364c-98c7-4171-8781-d530411a0a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.740755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-5f0d364c-98c7-4171-8781-d530411a0a96 None None] MFA Rules not processed for user `2047e91616814436939d27f4fa9ed5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.741981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5f0d364c-98c7-4171-8781-d530411a0a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.763277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 790/1612] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.764600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:58.774531 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20142de-4541-4057-8873-4b8d2814ba33 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:58.779078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a0b03-5de3-4cb6-b4ab-d816d23eb285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:58.780607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a0b03-5de3-4cb6-b4ab-d816d23eb285 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.780896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a0b03-5de3-4cb6-b4ab-d816d23eb285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.781178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a0b03-5de3-4cb6-b4ab-d816d23eb285 admin admin] PATH_INFO: `/v3/projects/09bc5c58fd414c8aa76756065678191e/users/4d834a0b1ec1481eaf1387dd4e302cd3/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.795121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a0b03-5de3-4cb6-b4ab-d816d23eb285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bc5c58fd414c8aa76756065678191e, user_id=4d834a0b1ec1481eaf1387dd4e302cd3, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:58.797907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a0b03-5de3-4cb6-b4ab-d816d23eb285 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:58.807285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 823/1613] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.808609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827369-ec5d-400c-8ba7-d2a2b16c3be1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.808887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827369-ec5d-400c-8ba7-d2a2b16c3be1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.809164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827369-ec5d-400c-8ba7-d2a2b16c3be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.838739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-41827369-ec5d-400c-8ba7-d2a2b16c3be1 None None] MFA Rules not processed for user `a0fb5c73c3c9411fa500edac52319899`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.838739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-41827369-ec5d-400c-8ba7-d2a2b16c3be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.899267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 824/1614] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.900615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.900911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.901199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.918774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 791/1615] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:58 2022] PUT /identity/v3/projects/09bc5c58fd414c8aa76756065678191e/users/4d834a0b1ec1481eaf1387dd4e302cd3/roles/246514336b4549609174329cae41663a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:58.922727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:58.922727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:58.922727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:58.923014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.923770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.939298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:58.952355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:58.981476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 825/1616] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:58.982407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.008588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 792/1617] 10.222.0.90 () {58 vars in 1058 bytes} [Mon Feb 21 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:59.010008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.022649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc963f1-caf2-4a28-b6ac-06832c21404a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.028162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ceb2c-2526-474a-bed1-2a20a775fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.028818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ceb2c-2526-474a-bed1-2a20a775fdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.029096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ceb2c-2526-474a-bed1-2a20a775fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.029371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ceb2c-2526-474a-bed1-2a20a775fdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.030142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ceb2c-2526-474a-bed1-2a20a775fdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.032173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ceb2c-2526-474a-bed1-2a20a775fdb7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.047384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02ae7-56ad-44fa-9e07-266839b5a901 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.050848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fe8df-b468-429b-be12-4cc4f69a95c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.051491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe8df-b468-429b-be12-4cc4f69a95c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.051771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe8df-b468-429b-be12-4cc4f69a95c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.052070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe8df-b468-429b-be12-4cc4f69a95c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.063347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe8df-b468-429b-be12-4cc4f69a95c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.064859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe8df-b468-429b-be12-4cc4f69a95c1 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.074406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 826/1618] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.075688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394075a-679c-4f6e-a509-6c8d1a558ac2 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.077941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394075a-679c-4f6e-a509-6c8d1a558ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.077941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394075a-679c-4f6e-a509-6c8d1a558ac2 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.078582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 827/1619] 10.222.0.90 () {54 vars in 961 bytes} [Mon Feb 21 01:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:59.079278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394075a-679c-4f6e-a509-6c8d1a558ac2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.126542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 793/1620] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:31:59 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:59.127797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.128084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.128552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.137362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394075a-679c-4f6e-a509-6c8d1a558ac2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.146578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:59.147772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:59.184541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.185208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.185484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.185764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.206680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 794/1621] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:59.207517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.244893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.246390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.257078 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 828/1622] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.257998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.266114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b852a7-a03b-4e4c-807c-f3dcb6ff0994 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.270251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13ce4a-026a-424d-8c90-678dec57d139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.271394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13ce4a-026a-424d-8c90-678dec57d139 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.271394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13ce4a-026a-424d-8c90-678dec57d139 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.271790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13ce4a-026a-424d-8c90-678dec57d139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.285701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13ce4a-026a-424d-8c90-678dec57d139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.286765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13ce4a-026a-424d-8c90-678dec57d139 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.299485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 795/1623] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.301175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.301776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.302145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.323922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:59.325606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:59.328505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda340a-f12e-41bd-9c3f-a9445bb9363b service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.334757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.335452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.335783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.336065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.337211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 796/1624] 10.222.0.90 () {58 vars in 1058 bytes} [Mon Feb 21 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:31:59.338079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.350145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb41306-9797-4609-84f9-7c476d7de99d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.355997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.356859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.357211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.357605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.358944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.361041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.406967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.408730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.419433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 829/1625] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.421042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.430608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd3205-c72c-40ff-bef7-4187dfd83890 service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.434491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.435475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.435475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.435781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.446318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.447821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.458409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 830/1626] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.459136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.471371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 797/1627] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:31:59 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:31:59.471904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5385-e9d4-4cc2-90df-e3cece0f6e28 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.476315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.479326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.480122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.480409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.480831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.502354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c39204-8407-4179-8126-9c50bd98f98b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.517278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.518032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.519742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.520237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.522296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.528133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.543904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.546027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.556933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 831/1628] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:59.568557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 798/1629] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:31:59.569796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.591704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c60adc-88f2-4322-801d-64ed3baf1f58 service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.601044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0232fd-278f-43b8-b300-6de4ac1dd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.612594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0232fd-278f-43b8-b300-6de4ac1dd795 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.612891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0232fd-278f-43b8-b300-6de4ac1dd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.615127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0232fd-278f-43b8-b300-6de4ac1dd795 admin admin] PATH_INFO: `/v3/projects/0607f40c8b3141658d4103d5d13783c0/users/740afcf8466f41a58c8b41a56fdc58c1/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.633971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0232fd-278f-43b8-b300-6de4ac1dd795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0607f40c8b3141658d4103d5d13783c0, user_id=740afcf8466f41a58c8b41a56fdc58c1, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.639134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0232fd-278f-43b8-b300-6de4ac1dd795 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.768061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 832/1630] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:59 2022] PUT /identity/v3/projects/0607f40c8b3141658d4103d5d13783c0/users/740afcf8466f41a58c8b41a56fdc58c1/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:59.771918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.789065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4b40-4490-40cf-9e5f-341bcdf4ad47 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.829724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18517588-00f4-4bab-9037-267acff33a47 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.830561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18517588-00f4-4bab-9037-267acff33a47 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.830856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18517588-00f4-4bab-9037-267acff33a47 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.833590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 833/1631] 10.222.0.90 () {54 vars in 912 bytes} [Mon Feb 21 01:31:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:59.856220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be43f24-82ca-4995-87f2-c1dbd7651c42 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.856699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be43f24-82ca-4995-87f2-c1dbd7651c42 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.856988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be43f24-82ca-4995-87f2-c1dbd7651c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.885314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9be43f24-82ca-4995-87f2-c1dbd7651c42 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:31:59.886545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9be43f24-82ca-4995-87f2-c1dbd7651c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:59.910992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c813-8ccb-44bc-9260-c1e50ad8c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:59.912110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c813-8ccb-44bc-9260-c1e50ad8c332 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.912400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c813-8ccb-44bc-9260-c1e50ad8c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.912703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c813-8ccb-44bc-9260-c1e50ad8c332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.913451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c813-8ccb-44bc-9260-c1e50ad8c332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:59.915910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c813-8ccb-44bc-9260-c1e50ad8c332 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:59.940447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 799/1632] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:31:59.943677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630a47-d152-4e3a-a763-6fa13262f754 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:59.943981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630a47-d152-4e3a-a763-6fa13262f754 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:59.944267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630a47-d152-4e3a-a763-6fa13262f754 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:59.946386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 800/1633] 10.222.0.90 () {54 vars in 912 bytes} [Mon Feb 21 01:31:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:31:59.947119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630a47-d152-4e3a-a763-6fa13262f754 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:59.989606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630a47-d152-4e3a-a763-6fa13262f754 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:59.999665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:00.002206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.002614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.002896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] PATH_INFO: `/v3/projects/0607f40c8b3141658d4103d5d13783c0/users/740afcf8466f41a58c8b41a56fdc58c1/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.007857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 834/1634] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:00.008099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0607f40c8b3141658d4103d5d13783c0, user_id=740afcf8466f41a58c8b41a56fdc58c1, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:00.009343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.009638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.009922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.024661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:00.035584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:00.036795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:00.049848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 835/1635] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:00.051576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:00.053070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:00.054992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 801/1636] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:31:59 2022] PUT /identity/v3/projects/0607f40c8b3141658d4103d5d13783c0/users/740afcf8466f41a58c8b41a56fdc58c1/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:00.064834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:00.163171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0800bb-f150-429c-b043-fdaefcbc4f09 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:00.172318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe35c3-4b38-4fc5-baf9-618653532391 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:00.172656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8c875-ca40-4c58-8142-984505ab6e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:00.172656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8c875-ca40-4c58-8142-984505ab6e60 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.172656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8c875-ca40-4c58-8142-984505ab6e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.172656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8c875-ca40-4c58-8142-984505ab6e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.222367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:00.223294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.223756 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.224164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.258390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8c875-ca40-4c58-8142-984505ab6e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:00.259566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8c875-ca40-4c58-8142-984505ab6e60 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:00.281132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 802/1637] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:00.287537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ac9c-29b4-4a8b-b7f0-9df34a1eb52d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.287537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ac9c-29b4-4a8b-b7f0-9df34a1eb52d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.287537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ac9c-29b4-4a8b-b7f0-9df34a1eb52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.322452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e902ac9c-29b4-4a8b-b7f0-9df34a1eb52d None None] MFA Rules not processed for user `740afcf8466f41a58c8b41a56fdc58c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:00.323999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e902ac9c-29b4-4a8b-b7f0-9df34a1eb52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:00.376365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:00.377896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:00.392893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 836/1638] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:00.541364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 803/1639] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:00.557609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:00.568302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c97a-63e6-4852-9a22-551d2c383220 service glance] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:00.572611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2965a90-d090-4bc1-b6ac-97414cbe05b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:00.573608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2965a90-d090-4bc1-b6ac-97414cbe05b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:00.574125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2965a90-d090-4bc1-b6ac-97414cbe05b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:00.574571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2965a90-d090-4bc1-b6ac-97414cbe05b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:00.645547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2965a90-d090-4bc1-b6ac-97414cbe05b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:00.645547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2965a90-d090-4bc1-b6ac-97414cbe05b9 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:00.659748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 837/1640] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:01.072583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc435-0b16-44fe-bdfa-1bead9cf2051 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.073078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc435-0b16-44fe-bdfa-1bead9cf2051 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.073394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc435-0b16-44fe-bdfa-1bead9cf2051 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.075331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 804/1641] 10.222.0.90 () {54 vars in 912 bytes} [Mon Feb 21 01:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:01.081126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fdacc-3017-476a-b427-f561e693fc5c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.081618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fdacc-3017-476a-b427-f561e693fc5c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.081742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fdacc-3017-476a-b427-f561e693fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.119240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3c9fdacc-3017-476a-b427-f561e693fc5c None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:01.120635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3c9fdacc-3017-476a-b427-f561e693fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:01.198621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 838/1642] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:01.221247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fc435-0b16-44fe-bdfa-1bead9cf2051 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:01.236105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fc435-0b16-44fe-bdfa-1bead9cf2051 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:01.238123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c18e-f3af-4972-8e6a-f807dcf4fea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:01.238837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c18e-f3af-4972-8e6a-f807dcf4fea4 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.239164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c18e-f3af-4972-8e6a-f807dcf4fea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.239442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c18e-f3af-4972-8e6a-f807dcf4fea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.247862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c18e-f3af-4972-8e6a-f807dcf4fea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:01.249610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c18e-f3af-4972-8e6a-f807dcf4fea4 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:01.259626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 805/1643] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:01.671678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.672229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.672229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.721072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] MFA Rules not processed for user `35d4828335a543758d1413c0276657a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:01.722997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:01.831556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 839/1644] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:01.843074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.846018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.847160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.881517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] MFA Rules not processed for user `35d4828335a543758d1413c0276657a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:01.896977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:01.918517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 806/1645] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:01.930875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:01.953335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03042ddf-b885-47ee-a750-3b13692dfd1f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:01.971373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae8d3c-a4e2-409f-a040-fafe1bfbd3af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:01.972138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8d3c-a4e2-409f-a040-fafe1bfbd3af service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.972418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8d3c-a4e2-409f-a040-fafe1bfbd3af service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.973423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8d3c-a4e2-409f-a040-fafe1bfbd3af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.982976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8d3c-a4e2-409f-a040-fafe1bfbd3af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:01.985488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8d3c-a4e2-409f-a040-fafe1bfbd3af service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:01.996191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 840/1646] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:02.085555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:02.209154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee6fba-6383-4b0d-9a94-ab00211d7e66 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:02.217639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:02.218494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.218801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.219185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:02.221425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:02.242251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:02.243883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079a1ad-deab-4421-8618-1103c624d8ae service placement] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:02.294170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 807/1647] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:02.407666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c88d-7d43-4bc4-8dc2-35ddd5b9530e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.407666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c88d-7d43-4bc4-8dc2-35ddd5b9530e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.407666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c88d-7d43-4bc4-8dc2-35ddd5b9530e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:02.407666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 841/1648] 10.222.0.90 () {54 vars in 912 bytes} [Mon Feb 21 01:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:02.415202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.416493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.417308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:02.450305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:02.452326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:02.463886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 808/1649] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:02.482097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c88d-7d43-4bc4-8dc2-35ddd5b9530e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:02.549258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c88d-7d43-4bc4-8dc2-35ddd5b9530e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:02.549258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d6318-73ab-465f-8b22-5ca6ce304611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:02.549258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6318-73ab-465f-8b22-5ca6ce304611 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.549258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6318-73ab-465f-8b22-5ca6ce304611 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.550443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6318-73ab-465f-8b22-5ca6ce304611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:02.550443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d6318-73ab-465f-8b22-5ca6ce304611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:02.550739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d6318-73ab-465f-8b22-5ca6ce304611 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:02.560288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 842/1650] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:04.805947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:04.980948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88b75-03df-4c32-8a6b-4398783fcf58 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:04.989060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:04.990490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:04.990828 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:04.991104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] PATH_INFO: `/v3/users/2047e91616814436939d27f4fa9ed5b8` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:04.992759 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2047e91616814436939d27f4fa9ed5b8)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:04.994698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:05.362396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2047e91616814436939d27f4fa9ed5b8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:05.363297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2047e91616814436939d27f4fa9ed5b8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:05.379953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2047e91616814436939d27f4fa9ed5b8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:05.403174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2047e91616814436939d27f4fa9ed5b8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:05.404223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2047e91616814436939d27f4fa9ed5b8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:05.509041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 809/1651] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:04 2022] DELETE /identity/v3/users/2047e91616814436939d27f4fa9ed5b8 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:05.514326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:05.515564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:05.516184 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:05.536511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:05.537988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:05.639665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 843/1652] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:05.666971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:05.668847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:05.770398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0747c6-d745-419d-9168-7579ce24b084 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:05.774755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fbfc6-f344-4246-a3ce-00c6c3a7ea2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:05.775702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbfc6-f344-4246-a3ce-00c6c3a7ea2f service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:05.776283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbfc6-f344-4246-a3ce-00c6c3a7ea2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:05.776732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbfc6-f344-4246-a3ce-00c6c3a7ea2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:05.795443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fbfc6-f344-4246-a3ce-00c6c3a7ea2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:05.795443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fbfc6-f344-4246-a3ce-00c6c3a7ea2f service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:05.815043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 810/1653] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:06.603017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:06.604649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:06.629994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071ae29-2c55-43a5-9b5d-de98e8832d12 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:06.635701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:06.636277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:06.636729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:06.637397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] PATH_INFO: `/v3/projects/78eb2e61f0d645fa999107e9c19a93a6` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:06.639619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78eb2e61f0d645fa999107e9c19a93a6)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:06.641799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:06.793255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78eb2e61f0d645fa999107e9c19a93a6', 'request_id': 'req-60cd5c72-a7c5-43dd-9910-781de8cff936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:07.057266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78eb2e61f0d645fa999107e9c19a93a6', 'request_id': 'req-60cd5c72-a7c5-43dd-9910-781de8cff936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:07.057266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78eb2e61f0d645fa999107e9c19a93a6', 'request_id': 'req-60cd5c72-a7c5-43dd-9910-781de8cff936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:07.057266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] The token cache is being invalidate because project 78eb2e61f0d645fa999107e9c19a93a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:07.057266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:07.083473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-60cd5c72-a7c5-43dd-9910-781de8cff936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:07.083473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 844/1654] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:06 2022] DELETE /identity/v3/projects/78eb2e61f0d645fa999107e9c19a93a6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:07.086987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.086987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.086987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.086987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:07.086987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:07.086987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 811/1655] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:07.087735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.087735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.087735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.101773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:07.103185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:07.112787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 845/1656] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:07.117176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:07.127815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3083c6-fb5f-4dea-8a9c-0c84963dfafc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:07.134902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:07.136123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.137035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.137477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.139834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:32:07.140498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:07.144142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:07.157667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 812/1657] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:32:07.162410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:07.171591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188d47-93ec-4c43-8db6-bca47f49e6d3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:07.176915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:07.177648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.178020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.178354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.179114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:07.181179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:07.293611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 846/1658] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:07 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:07.294592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:07.305798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ffa0-bca5-444e-bce1-608fe2c542b4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:07.377075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:07.378661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.379138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.379707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.381055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:07.385059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:07.475305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 813/1659] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:07 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:07.479385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:07.509722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66755d-543f-4b72-8743-3442dafe82c2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:07.533377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:07.535761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.537643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.538075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.544614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:07.548921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:07.584267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 847/1660] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:07.588764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:07.602498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc940a-88a9-4dfa-8f0b-a62dfcbc36dc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:07.616818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4e34c-74b6-48f0-b97c-ce197d820f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:07.618959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e34c-74b6-48f0-b97c-ce197d820f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.619528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e34c-74b6-48f0-b97c-ce197d820f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.619946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e34c-74b6-48f0-b97c-ce197d820f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.620988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4e34c-74b6-48f0-b97c-ce197d820f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:07.622747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4e34c-74b6-48f0-b97c-ce197d820f4f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:07.647533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 814/1661] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:07.657866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:07.670913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35fb3-5ef7-429f-aee7-0912b07f4971 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:07.679271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:07.680309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.680729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.681109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] PATH_INFO: `/v3/projects/0a255d9d7e2d4887928944757d8dd246/users/738dd8536500418bb42e47aa37c3b507/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.699215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a255d9d7e2d4887928944757d8dd246, user_id=738dd8536500418bb42e47aa37c3b507, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:07.703061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:07.807660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 848/1662] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:07 2022] PUT /identity/v3/projects/0a255d9d7e2d4887928944757d8dd246/users/738dd8536500418bb42e47aa37c3b507/roles/246514336b4549609174329cae41663a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:07.822294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:07.822581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:07.822857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:07.865923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] MFA Rules not processed for user `738dd8536500418bb42e47aa37c3b507`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:07.867213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:07.953263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 815/1663] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:07.957939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.091336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ced326-0071-4d2e-bc57-c778c1397903 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:08.096945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:08.097964 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.098379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.098786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.099849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:08.101982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:08.234618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 849/1664] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:07 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:08.240018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.264171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8f6a-8585-4cad-953d-6ef881d91d26 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:08.397625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:08.398550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.404112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.404112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.404112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:08.404112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:08.497816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 816/1665] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:08 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:08.504213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.516712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3022-4ae0-4e47-a1d3-7b01491eb75b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:08.523680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:08.524617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.525007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.525459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.526426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:08.528144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:08.556354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 850/1666] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:08.560208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.572188 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e0f36-3161-45a0-b346-e649f39f1653 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:08.583832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:08.598990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.599592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.600010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] PATH_INFO: `/v3/projects/083721edf1e244678144ec4277581951/users/605d8f699fba424baf0552f6842e21c2/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.647889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083721edf1e244678144ec4277581951, user_id=605d8f699fba424baf0552f6842e21c2, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:08.656915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:08.849790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 817/1667] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:08 2022] PUT /identity/v3/projects/083721edf1e244678144ec4277581951/users/605d8f699fba424baf0552f6842e21c2/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:08.857710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.876834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aceec-31ea-4d2c-a25e-c3eb2bc23232 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:09.007946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ec0dd-b498-4ad0-bede-ec065e648017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:09.008684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ec0dd-b498-4ad0-bede-ec065e648017 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:09.009028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ec0dd-b498-4ad0-bede-ec065e648017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:09.009312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ec0dd-b498-4ad0-bede-ec065e648017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:09.010054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ec0dd-b498-4ad0-bede-ec065e648017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:09.011698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ec0dd-b498-4ad0-bede-ec065e648017 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:09.035494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 851/1668] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:09.040064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:09.055324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ba806-83ba-4d25-96fb-740975d275e1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:09.089107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:09.090177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:09.090530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:09.090810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] PATH_INFO: `/v3/projects/083721edf1e244678144ec4277581951/users/605d8f699fba424baf0552f6842e21c2/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:09.094528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=083721edf1e244678144ec4277581951, user_id=605d8f699fba424baf0552f6842e21c2, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:09.097430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:09.124277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 818/1669] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:09 2022] PUT /identity/v3/projects/083721edf1e244678144ec4277581951/users/605d8f699fba424baf0552f6842e21c2/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:09.135266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:09.135563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:09.135849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:09.204740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] MFA Rules not processed for user `605d8f699fba424baf0552f6842e21c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:09.206167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:09.375384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 852/1670] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:09.385615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:09.387755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:09.523325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a1d69-1e59-409a-bc6c-d6ef56f613ec admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:09.524693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:09.525370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:09.525655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:09.525929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:09.546195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:09.547860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:09.570164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 819/1671] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:09.867249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:09.879647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133293-a06f-4b80-9bd4-a2fc4273da34 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:09.894165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aaa1c1-ec19-4ce2-952f-9f939ba011ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:09.894165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaa1c1-ec19-4ce2-952f-9f939ba011ba service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:09.894165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaa1c1-ec19-4ce2-952f-9f939ba011ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:09.894165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaa1c1-ec19-4ce2-952f-9f939ba011ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:10.026780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aaa1c1-ec19-4ce2-952f-9f939ba011ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:10.028265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aaa1c1-ec19-4ce2-952f-9f939ba011ba service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:10.056229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 853/1672] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:11.432376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:11.441378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270003-a499-44cd-a21d-169168522943 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:11.451594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:11.452411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:11.455042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:11.455042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:11.456877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:11.659410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:11.661139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2612b1-6133-4fb1-8564-f76fbddce93f service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:11.697316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 820/1673] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:11.782473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:11.782473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:11.783157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:11.865998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859be37-816a-43e8-b738-85a5c5cad125 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:11.867216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859be37-816a-43e8-b738-85a5c5cad125 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:11.867731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859be37-816a-43e8-b738-85a5c5cad125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:11.892228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] MFA Rules not processed for user `ab38a084fbb643298d38c4cd8dcf87cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:11.893687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:11.925460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8859be37-816a-43e8-b738-85a5c5cad125 None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:11.950728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8859be37-816a-43e8-b738-85a5c5cad125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:12.085168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 854/1674] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:12.109503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:12.114089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:12.151161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 821/1675] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:12.272680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:12.273305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:12.273796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:12.301623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326ad6-d8e0-4dd9-880f-8707f5ddb615 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:12.319559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581498b-aaf0-4ade-ba1c-6c047beddd90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:12.320911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581498b-aaf0-4ade-ba1c-6c047beddd90 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:12.322277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581498b-aaf0-4ade-ba1c-6c047beddd90 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:12.322707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581498b-aaf0-4ade-ba1c-6c047beddd90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:12.343451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] MFA Rules not processed for user `f213f03b8c094202b25d6a1fcccb5994`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:12.345861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:12.365036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581498b-aaf0-4ade-ba1c-6c047beddd90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:12.372830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581498b-aaf0-4ade-ba1c-6c047beddd90 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:12.396418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 855/1676] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:12.449152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 822/1677] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:12.460149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:12.460452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:12.460762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:12.510361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] MFA Rules not processed for user `f213f03b8c094202b25d6a1fcccb5994`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:12.511574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:12.531601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 856/1678] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:12.791934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:12.793657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:12.967632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc08ebb-3539-48f5-b705-4822025f3294 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:12.970034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:12.994133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9913-4167-4b4b-896d-82b3a4dfa715 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:12.996706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4028f3-898b-42e4-b91d-6065c2db87cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:12.997483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4028f3-898b-42e4-b91d-6065c2db87cc service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.002864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4028f3-898b-42e4-b91d-6065c2db87cc service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.005610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4028f3-898b-42e4-b91d-6065c2db87cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.019899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:13.020595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.022874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.022874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.035940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4028f3-898b-42e4-b91d-6065c2db87cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:13.039290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4028f3-898b-42e4-b91d-6065c2db87cc service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:13.052600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:13.054402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:13.070292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 823/1679] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:32:13.071703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a1e7-d128-4517-b23e-84d6a28ef6ed None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.082032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a1e7-d128-4517-b23e-84d6a28ef6ed None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.082411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96a1e7-d128-4517-b23e-84d6a28ef6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.087456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 857/1680] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:13.139109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2c96a1e7-d128-4517-b23e-84d6a28ef6ed None None] MFA Rules not processed for user `4d834a0b1ec1481eaf1387dd4e302cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:13.140305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2c96a1e7-d128-4517-b23e-84d6a28ef6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:13.411137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 824/1681] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:13.525095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:13.528058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:13.583899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973be95-f710-47bc-b32a-7a555033b0fa service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:13.627189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf31355-9b2e-46d4-a370-47a00deaec51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:13.648873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31355-9b2e-46d4-a370-47a00deaec51 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:13.648873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31355-9b2e-46d4-a370-47a00deaec51 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:13.648873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31355-9b2e-46d4-a370-47a00deaec51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:13.686137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf31355-9b2e-46d4-a370-47a00deaec51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:13.687953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf31355-9b2e-46d4-a370-47a00deaec51 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:13.738711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 858/1682] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:16.494915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:16.495500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:16.495707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:16.547104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] MFA Rules not processed for user `f213f03b8c094202b25d6a1fcccb5994`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:16.548349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:16.581942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 825/1683] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:18.892323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:18.892947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:18.892947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:18.936925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:18.939737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:19.052018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 859/1684] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Feb 21 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:19.085811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:19.088302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:19.092594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:19.094695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:19.118919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d105-e3c6-4654-b52c-14448a208387 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:19.131279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6ce96-f550-4a9d-81dd-2680f56f32ee None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:19.139090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86359a50-ad41-4ce6-8cb5-1654f8a99fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:19.141555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86359a50-ad41-4ce6-8cb5-1654f8a99fde service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:19.142532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb49a-48a9-4334-baad-98d9a06a41da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:19.143446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb49a-48a9-4334-baad-98d9a06a41da service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:19.143958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86359a50-ad41-4ce6-8cb5-1654f8a99fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:19.145678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb49a-48a9-4334-baad-98d9a06a41da service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:19.146164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb49a-48a9-4334-baad-98d9a06a41da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:19.146501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86359a50-ad41-4ce6-8cb5-1654f8a99fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:19.161491 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb49a-48a9-4334-baad-98d9a06a41da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:19.163123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86359a50-ad41-4ce6-8cb5-1654f8a99fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:19.166372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb49a-48a9-4334-baad-98d9a06a41da service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:19.168447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86359a50-ad41-4ce6-8cb5-1654f8a99fde service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:19.195527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 860/1685] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:19.197044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 826/1686] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:19.569518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda917fe-3259-4256-846a-daa73e77d468 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:19.570068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda917fe-3259-4256-846a-daa73e77d468 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:19.570672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda917fe-3259-4256-846a-daa73e77d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:19.689689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-eda917fe-3259-4256-846a-daa73e77d468 None None] MFA Rules not processed for user `ab38a084fbb643298d38c4cd8dcf87cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:19.689689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eda917fe-3259-4256-846a-daa73e77d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:19.726331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 861/1687] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:20.019277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a70e-5c76-4af8-806a-ba5f0a8a406b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:20.019555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a70e-5c76-4af8-806a-ba5f0a8a406b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:20.020061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a70e-5c76-4af8-806a-ba5f0a8a406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:20.074908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3c64a70e-5c76-4af8-806a-ba5f0a8a406b None None] MFA Rules not processed for user `4d834a0b1ec1481eaf1387dd4e302cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:20.076194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3c64a70e-5c76-4af8-806a-ba5f0a8a406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:20.116357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 827/1688] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:22.240911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658136-0a10-4928-9554-41d5751e4055 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.242469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658136-0a10-4928-9554-41d5751e4055 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.242766 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658136-0a10-4928-9554-41d5751e4055 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:22.246372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 862/1689] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:32:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:22.257370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5769ad-2cd5-4b58-b9c8-735166f49f4d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.258229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5769ad-2cd5-4b58-b9c8-735166f49f4d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.259569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5769ad-2cd5-4b58-b9c8-735166f49f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:22.285164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1d5769ad-2cd5-4b58-b9c8-735166f49f4d None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:22.286975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1d5769ad-2cd5-4b58-b9c8-735166f49f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:22.297457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 828/1690] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:22.322670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e717e-3b35-4e4e-be91-87919672621e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.323230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e717e-3b35-4e4e-be91-87919672621e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.323660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e717e-3b35-4e4e-be91-87919672621e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:22.325700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 863/1691] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:22.341157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.341695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.342186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:22.364041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:22.365799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:22.378971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 829/1692] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:23.068259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e717e-3b35-4e4e-be91-87919672621e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:23.088252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e717e-3b35-4e4e-be91-87919672621e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:23.105164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:23.105895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:23.106112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:23.106394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:23.126173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:23.134029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:23.147674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 864/1693] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:23.269769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:23.293060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e8bb-df72-4398-b3aa-ae2495dbc4f7 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:23.301256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c56cb-8a93-48d1-9970-12da40cbdd8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:23.301929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c56cb-8a93-48d1-9970-12da40cbdd8f service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:23.302381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c56cb-8a93-48d1-9970-12da40cbdd8f service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:23.302669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c56cb-8a93-48d1-9970-12da40cbdd8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:23.314923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c56cb-8a93-48d1-9970-12da40cbdd8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:23.316998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c56cb-8a93-48d1-9970-12da40cbdd8f service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:23.336199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 830/1694] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:29.385622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:29.387891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:29.512416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b3671-83d9-430b-be8a-d81a4ed60a57 service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:29.517324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:29.518325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:29.518683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:29.519026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] PATH_INFO: `/v3/users/a0fb5c73c3c9411fa500edac52319899` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:29.520540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fb5c73c3c9411fa500edac52319899)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:29.523101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: WARNING py.warnings [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:29.523101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: warnings.warn(msg) Feb 21 01:32:29.523101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: Feb 21 01:32:29.524624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:29.713625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fb5c73c3c9411fa500edac52319899'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:29.729422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fb5c73c3c9411fa500edac52319899'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:29.758657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fb5c73c3c9411fa500edac52319899'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:29.841692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fb5c73c3c9411fa500edac52319899'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:29.842905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fb5c73c3c9411fa500edac52319899'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:29.852717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 865/1695] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:29 2022] DELETE /identity/v3/users/a0fb5c73c3c9411fa500edac52319899 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:29.857898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:29.859675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:29.860258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:29.883875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:29.886712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:30.006225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 831/1696] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:30.242658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:30.247555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:30.429631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc2ccb-d9e8-4913-aa64-88b6b55acdc4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:30.439513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7db3e-289f-4b93-beac-1f9f5c86f9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:30.457172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7db3e-289f-4b93-beac-1f9f5c86f9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:30.457635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7db3e-289f-4b93-beac-1f9f5c86f9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:30.457932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7db3e-289f-4b93-beac-1f9f5c86f9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:30.479682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7db3e-289f-4b93-beac-1f9f5c86f9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:30.486000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7db3e-289f-4b93-beac-1f9f5c86f9f3 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:30.506730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 866/1697] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:31.747557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:31.749187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:31.772148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438528-26c1-43f8-b046-acf98cc0d2c8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:31.777569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:31.779812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:31.780318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:31.780774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] PATH_INFO: `/v3/projects/b08ce2fecf1244daa2530b60e3010c19` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:31.782528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08ce2fecf1244daa2530b60e3010c19)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:31.783762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: WARNING py.warnings [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:31.783762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: warnings.warn(msg) Feb 21 01:32:31.783762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: Feb 21 01:32:31.785847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:31.940765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08ce2fecf1244daa2530b60e3010c19', 'request_id': 'req-e720a1bd-b72b-4c19-8396-72600ff4b398'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:31.956129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08ce2fecf1244daa2530b60e3010c19', 'request_id': 'req-e720a1bd-b72b-4c19-8396-72600ff4b398'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:31.962893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08ce2fecf1244daa2530b60e3010c19', 'request_id': 'req-e720a1bd-b72b-4c19-8396-72600ff4b398'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:32.060623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] The token cache is being invalidate because project b08ce2fecf1244daa2530b60e3010c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:32.066958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:32.066958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e720a1bd-b72b-4c19-8396-72600ff4b398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:32.066958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 832/1698] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:31 2022] DELETE /identity/v3/projects/b08ce2fecf1244daa2530b60e3010c19 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:32.071020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.071483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.071570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.089961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:32.091442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:32.162795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 867/1699] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:32.171191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.171415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.171713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.190748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:32.191933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:32.199796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 833/1700] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:32.204111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.213773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc58738-2663-4e3e-822a-518bb9068915 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.218387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.219045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.219331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.219611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.220356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:32:32.220769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.222367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:32.235755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 868/1701] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:32:32.240467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.254083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90fe8-a13e-4b3d-9601-82b8c65d9224 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.255622 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.256288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.256665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.256862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.257871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.259915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:32.380704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 834/1702] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:32 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:32.385066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.395017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0025e-c2cd-4e82-8e1a-16467b96942d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.448751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.449475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.449751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.450031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.450793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.452669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:32.547783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 869/1703] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:32 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:32:32.552375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.564723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3919cf4-1be7-498b-a8bc-188ca076922a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.570249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.571374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.571805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.572228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.573460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.576046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:32.600816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 835/1704] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:32.602220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.618533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e0e5-cfc7-4a37-aa17-447522fdac28 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.623215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5f640-3be4-4ce4-b15d-da42f60f204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.624024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5f640-3be4-4ce4-b15d-da42f60f204e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.627710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5f640-3be4-4ce4-b15d-da42f60f204e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.627710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5f640-3be4-4ce4-b15d-da42f60f204e admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.627710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5f640-3be4-4ce4-b15d-da42f60f204e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.627710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5f640-3be4-4ce4-b15d-da42f60f204e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:32.640418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 870/1705] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:32.644597 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.664219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a77eb-d2ea-4dce-add6-2a83d6641c8f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.669981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.670980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.671264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.671542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] PATH_INFO: `/v3/projects/ad25bef882fe47e0bb601d5062fa098c/users/ea35b6bbf444423da92c9259d08c08fd/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.686768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad25bef882fe47e0bb601d5062fa098c, user_id=ea35b6bbf444423da92c9259d08c08fd, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.689485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:32.774044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 836/1706] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:32 2022] PUT /identity/v3/projects/ad25bef882fe47e0bb601d5062fa098c/users/ea35b6bbf444423da92c9259d08c08fd/roles/246514336b4549609174329cae41663a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:32.792289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.792613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.792894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.819563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] MFA Rules not processed for user `ea35b6bbf444423da92c9259d08c08fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:32.820826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:32.883646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 871/1707] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:32.888116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:32.947575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2581-4deb-4ed5-baba-d2eb874c7a7a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:32.952873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:32.953499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:32.953785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:32.954063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:32.954747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:32.956723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.038278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 837/1708] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:32 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:32:33.048615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.059583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0719-38cd-42aa-a572-10063e9e41c3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.114459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.115107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.115391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.115665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.116359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.118308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.220243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 872/1709] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:33 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:33.224158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.234015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0daa9-9882-4d3b-9e2d-97ed4b3fbe39 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.238582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.239226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.239506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.239779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.240529 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.242144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.252100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 838/1710] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:33.256146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.266649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2ec63-be49-4a67-b4d2-1bd5662d2cf5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.271166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.272028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.272305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.272614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] PATH_INFO: `/v3/projects/3599e9c30b1c43f9947b829f9484fdb5/users/9d0e4e24c5504fad8b2b9ca0b26f661d/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.286998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3599e9c30b1c43f9947b829f9484fdb5, user_id=9d0e4e24c5504fad8b2b9ca0b26f661d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.289688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.374382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 873/1711] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:33 2022] PUT /identity/v3/projects/3599e9c30b1c43f9947b829f9484fdb5/users/9d0e4e24c5504fad8b2b9ca0b26f661d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:33.378337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.388953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a728056-1163-4ff9-9632-c7ef4830c5a1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.442894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba464f-e2b1-40d3-b22c-48c55343ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.443546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba464f-e2b1-40d3-b22c-48c55343ca16 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.443827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba464f-e2b1-40d3-b22c-48c55343ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.444096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba464f-e2b1-40d3-b22c-48c55343ca16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.444872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba464f-e2b1-40d3-b22c-48c55343ca16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.446449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba464f-e2b1-40d3-b22c-48c55343ca16 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.456307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 839/1712] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:33.460291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.470170 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa823cf-c903-4237-84d7-4e8dca3a9154 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.474761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.480745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.480745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.480745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] PATH_INFO: `/v3/projects/3599e9c30b1c43f9947b829f9484fdb5/users/9d0e4e24c5504fad8b2b9ca0b26f661d/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.480745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3599e9c30b1c43f9947b829f9484fdb5, user_id=9d0e4e24c5504fad8b2b9ca0b26f661d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.481059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.490749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 874/1713] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:33 2022] PUT /identity/v3/projects/3599e9c30b1c43f9947b829f9484fdb5/users/9d0e4e24c5504fad8b2b9ca0b26f661d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:33.501318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.503727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.504024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.539674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] MFA Rules not processed for user `9d0e4e24c5504fad8b2b9ca0b26f661d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:33.540906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:33.604673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 840/1714] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:33.615200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.617080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:33.676128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c50a13-f2d8-45b5-85be-7205c430bf91 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.680110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe214a7-bef6-4867-81f3-31b57f833e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.680792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe214a7-bef6-4867-81f3-31b57f833e17 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.681074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe214a7-bef6-4867-81f3-31b57f833e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.681349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe214a7-bef6-4867-81f3-31b57f833e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.692685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe214a7-bef6-4867-81f3-31b57f833e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.694147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe214a7-bef6-4867-81f3-31b57f833e17 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.704277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 875/1715] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:33.787896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.848828 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56aa15-1995-4457-b3d8-ffa3c956d75a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.854814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.855821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.856101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.856375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] PATH_INFO: `/v3/users/ea35b6bbf444423da92c9259d08c08fd` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.858186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea35b6bbf444423da92c9259d08c08fd)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.860090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:34.078654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea35b6bbf444423da92c9259d08c08fd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.079374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea35b6bbf444423da92c9259d08c08fd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.093615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea35b6bbf444423da92c9259d08c08fd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.105697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea35b6bbf444423da92c9259d08c08fd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.106456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea35b6bbf444423da92c9259d08c08fd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.221954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 841/1716] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:33 2022] DELETE /identity/v3/users/ea35b6bbf444423da92c9259d08c08fd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:34.226328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:34.226745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:34.226919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:34.250003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:34.251564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:34.319270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 876/1717] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:34.328984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:34.330862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:34.391214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be99b3-b76d-4be0-9077-4c2d050676f9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:34.394857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:34.395503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:34.395784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:34.396058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:34.405582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:34.406998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:34.416172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 842/1718] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:34.769704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:34.771183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:34.783686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf6fc-15d1-4d36-9b88-3ef9bdda9c09 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:34.788260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:34.789163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:34.789443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:34.789715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] PATH_INFO: `/v3/projects/ad25bef882fe47e0bb601d5062fa098c` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:34.790938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad25bef882fe47e0bb601d5062fa098c)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:34.792909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:34.910833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad25bef882fe47e0bb601d5062fa098c', 'request_id': 'req-388a056a-47d0-421b-a6b9-c1a7c9fdf853'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.973888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad25bef882fe47e0bb601d5062fa098c', 'request_id': 'req-388a056a-47d0-421b-a6b9-c1a7c9fdf853'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.980448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad25bef882fe47e0bb601d5062fa098c', 'request_id': 'req-388a056a-47d0-421b-a6b9-c1a7c9fdf853'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.990630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] The token cache is being invalidate because project ad25bef882fe47e0bb601d5062fa098c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:34.990925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.991569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:34.993241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 877/1719] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:34 2022] DELETE /identity/v3/projects/ad25bef882fe47e0bb601d5062fa098c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:34.997650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:35.006875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4d45-af4a-4a8e-b74f-2b60ac339199 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:35.061130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:35.061998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:35.062280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:35.062559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] PATH_INFO: `/v3/users/9d0e4e24c5504fad8b2b9ca0b26f661d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:35.063753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0e4e24c5504fad8b2b9ca0b26f661d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:35.065703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:35.203493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0e4e24c5504fad8b2b9ca0b26f661d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:35.204125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0e4e24c5504fad8b2b9ca0b26f661d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:35.210567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0e4e24c5504fad8b2b9ca0b26f661d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:35.221655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0e4e24c5504fad8b2b9ca0b26f661d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:35.222360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-071d08bc-537c-420d-832d-d96ce14326ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0e4e24c5504fad8b2b9ca0b26f661d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:35.280883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 843/1720] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:34 2022] DELETE /identity/v3/users/9d0e4e24c5504fad8b2b9ca0b26f661d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:36.294493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:36.296052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:36.311395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a056a-47d0-421b-a6b9-c1a7c9fdf853 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:36.396474 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:36.397836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:36.398314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:36.398985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] PATH_INFO: `/v3/projects/3599e9c30b1c43f9947b829f9484fdb5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:36.401224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3599e9c30b1c43f9947b829f9484fdb5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:36.403961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:36.579264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3599e9c30b1c43f9947b829f9484fdb5', 'request_id': 'req-0c4b8e58-6a70-4828-a073-dcccb9405f12'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:36.672159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3599e9c30b1c43f9947b829f9484fdb5', 'request_id': 'req-0c4b8e58-6a70-4828-a073-dcccb9405f12'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:36.683610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3599e9c30b1c43f9947b829f9484fdb5', 'request_id': 'req-0c4b8e58-6a70-4828-a073-dcccb9405f12'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:36.698051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] The token cache is being invalidate because project 3599e9c30b1c43f9947b829f9484fdb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:36.698469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:36.699067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0c4b8e58-6a70-4828-a073-dcccb9405f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:36.701578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 878/1721] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:36 2022] DELETE /identity/v3/projects/3599e9c30b1c43f9947b829f9484fdb5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:36.706229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:36.706704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:36.706845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:36.730454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:36.731683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:36.863108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 844/1722] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:36.872957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:36.872957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:36.872957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:36.894714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:36.895939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:36.908558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 879/1723] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:36.912668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:36.928445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70081cb-58dc-499f-b618-7268562f0470 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:36.933588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:36.949256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:36.949256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:36.949256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:36.949256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:32:36.949256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:36.952006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:36.994735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 845/1724] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:32:36.999545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:37.016992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52a546-fab3-4bc1-8073-070799dfd960 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:37.027803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:37.045777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.045777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.045777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.045777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:37.045777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:37.197247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 880/1725] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:36 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:37.198032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:37.210134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6017-670b-41e2-b5bf-fd4d75f09795 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:37.278072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:37.279256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.279611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.280469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.281263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:37.283311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:37.430737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 846/1726] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:37 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:37.438019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:37.448732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0cf29-84c3-46fb-914d-afcb5d0aeac7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:37.454194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:37.454881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.455165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.455626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.456375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:37.459186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:37.490401 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 881/1727] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:37.490821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:37.507750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23edbf9-022f-4662-92a4-7b9f4303f614 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:37.517318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde945c-5a01-4c9a-a3e9-605e5931e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:37.518058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde945c-5a01-4c9a-a3e9-605e5931e108 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.518174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde945c-5a01-4c9a-a3e9-605e5931e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.518496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde945c-5a01-4c9a-a3e9-605e5931e108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.519238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde945c-5a01-4c9a-a3e9-605e5931e108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:37.521062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde945c-5a01-4c9a-a3e9-605e5931e108 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:37.549454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 847/1728] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:37.553663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:37.579114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7b48-f270-427b-af3f-a5313cb7b42d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:37.586098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:37.589346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.589873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.590417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] PATH_INFO: `/v3/projects/1376619ce7e8437ebf50b80227330e2f/users/b43d50073a334cb38f29bda5330f2980/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.642189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1376619ce7e8437ebf50b80227330e2f, user_id=b43d50073a334cb38f29bda5330f2980, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:37.645201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:37.778104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 882/1729] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:37 2022] PUT /identity/v3/projects/1376619ce7e8437ebf50b80227330e2f/users/b43d50073a334cb38f29bda5330f2980/roles/246514336b4549609174329cae41663a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:37.791303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.792496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.793177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.843002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] MFA Rules not processed for user `b43d50073a334cb38f29bda5330f2980`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:37.844249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:37.917722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 848/1730] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:37.922690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:37.986962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d0d6-900b-454a-bf2e-95bdafd0f45f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:37.993556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:37.994237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:37.994521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:37.994803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:37.995506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:37.997575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.077480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 883/1731] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:37 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:38.079011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:38.090475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901fc3-0601-41b9-89b8-948ada136d11 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:38.148266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:38.148971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.149253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.149638 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.150886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:38.152897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.254494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 849/1732] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:38 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:32:38.258778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:38.271661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665612d3-a1ac-4912-82df-11e3a85cb205 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:38.281037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:38.281861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.282190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.282541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.283503 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:38.285241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.301196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 884/1733] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:32:38.302636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:38.313732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dead72-1642-46b9-b7e7-b7e6a511c5c3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:38.318717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:38.319722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.320077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.320355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] PATH_INFO: `/v3/projects/32dbdd6518b145a8a4a1896190741f7e/users/cd8669cd42b44dd693bef0cadd81807d/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.336753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dbdd6518b145a8a4a1896190741f7e, user_id=cd8669cd42b44dd693bef0cadd81807d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:38.339708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.455842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 850/1734] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:38 2022] PUT /identity/v3/projects/32dbdd6518b145a8a4a1896190741f7e/users/cd8669cd42b44dd693bef0cadd81807d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:38.459511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:38.471362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad897619-be66-441e-884b-b2af0fd69b4c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:38.531891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a3fb6-6e61-4e99-9e2c-633a92c8904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:38.532744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3fb6-6e61-4e99-9e2c-633a92c8904b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.533030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3fb6-6e61-4e99-9e2c-633a92c8904b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.533387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3fb6-6e61-4e99-9e2c-633a92c8904b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.534037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3fb6-6e61-4e99-9e2c-633a92c8904b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:38.536013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3fb6-6e61-4e99-9e2c-633a92c8904b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.546008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 885/1735] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:32:38.550126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:38.561266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d3cb-0b18-4c66-a8d6-781aca8e262d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:38.570091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:38.571215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.571506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.571784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] PATH_INFO: `/v3/projects/32dbdd6518b145a8a4a1896190741f7e/users/cd8669cd42b44dd693bef0cadd81807d/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.573936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dbdd6518b145a8a4a1896190741f7e, user_id=cd8669cd42b44dd693bef0cadd81807d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:38.577272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.589859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 851/1736] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:38 2022] PUT /identity/v3/projects/32dbdd6518b145a8a4a1896190741f7e/users/cd8669cd42b44dd693bef0cadd81807d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:38.600160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.600556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.600985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.635267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] MFA Rules not processed for user `cd8669cd42b44dd693bef0cadd81807d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:38.638305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:38.745104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 886/1737] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:38.756237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:38.758232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:38.843636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c3768-f421-484f-b717-8ecf4499ea39 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:38.848011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:38.848777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:38.849121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:38.849458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:38.864835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:38.864835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:38.875779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 852/1738] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:39.072605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:39.082914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:39.089256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843e2ec-7bc2-4708-9989-9f2833a9c96f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:39.093381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332197-63aa-4f49-ba76-e162136319e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:39.094089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332197-63aa-4f49-ba76-e162136319e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:39.094368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332197-63aa-4f49-ba76-e162136319e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:39.094636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332197-63aa-4f49-ba76-e162136319e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:39.170814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332197-63aa-4f49-ba76-e162136319e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:39.172391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332197-63aa-4f49-ba76-e162136319e3 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:39.181288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 887/1739] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:39.812733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:39.878240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d1f1-e0d4-4a4a-9948-f35fa0acc93b service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:39.883305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:39.884246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:39.884635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:39.884980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] PATH_INFO: `/v3/users/b43d50073a334cb38f29bda5330f2980` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:39.886242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43d50073a334cb38f29bda5330f2980)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:39.888813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:40.079187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43d50073a334cb38f29bda5330f2980'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:40.079845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43d50073a334cb38f29bda5330f2980'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:40.086643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43d50073a334cb38f29bda5330f2980'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:40.097807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43d50073a334cb38f29bda5330f2980'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:40.098484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43d50073a334cb38f29bda5330f2980'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:40.174393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 853/1740] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:39 2022] DELETE /identity/v3/users/b43d50073a334cb38f29bda5330f2980 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:40.185809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:40.185809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:40.185809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:40.204928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:40.206317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:40.264751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 888/1741] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:40.275070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:40.276416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:40.332588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2998c2-2df7-4a63-8422-f0ec24aa7d46 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:40.336150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:40.336815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:40.337091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:40.350443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:40.350443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:40.350443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:40.356396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 854/1742] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:40.786932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:40.788925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:40.804140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ddbf1-48e1-4f6d-8acc-a21b9cd66292 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:40.811923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:40.813674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:40.813674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:40.813674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] PATH_INFO: `/v3/projects/1376619ce7e8437ebf50b80227330e2f` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:40.814957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1376619ce7e8437ebf50b80227330e2f)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:40.817154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:40.958081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1376619ce7e8437ebf50b80227330e2f', 'request_id': 'req-d9040cdb-cf67-422b-9f71-0fb79480a59e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.040670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1376619ce7e8437ebf50b80227330e2f', 'request_id': 'req-d9040cdb-cf67-422b-9f71-0fb79480a59e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.048239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1376619ce7e8437ebf50b80227330e2f', 'request_id': 'req-d9040cdb-cf67-422b-9f71-0fb79480a59e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.058849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] The token cache is being invalidate because project 1376619ce7e8437ebf50b80227330e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:41.059142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.059827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.061414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 889/1743] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:40 2022] DELETE /identity/v3/projects/1376619ce7e8437ebf50b80227330e2f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:41.070461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:41.079810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ef12a-0602-48ef-8e0e-6cb192f99226 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:41.134833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:41.135706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:41.135993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:41.136270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] PATH_INFO: `/v3/users/cd8669cd42b44dd693bef0cadd81807d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:41.137574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8669cd42b44dd693bef0cadd81807d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:41.139502 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:41.328295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8669cd42b44dd693bef0cadd81807d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.329034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8669cd42b44dd693bef0cadd81807d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.336302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8669cd42b44dd693bef0cadd81807d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.348217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8669cd42b44dd693bef0cadd81807d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.348940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6da97c31-b0a0-44e2-93c6-074063398c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8669cd42b44dd693bef0cadd81807d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:41.400766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 855/1744] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:41 2022] DELETE /identity/v3/users/cd8669cd42b44dd693bef0cadd81807d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:41.877347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:41.878813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:41.893556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040cdb-cf67-422b-9f71-0fb79480a59e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:41.948535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:41.949484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:41.949716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:41.949991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] PATH_INFO: `/v3/projects/32dbdd6518b145a8a4a1896190741f7e` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:41.951181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32dbdd6518b145a8a4a1896190741f7e)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:41.953163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.106699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32dbdd6518b145a8a4a1896190741f7e', 'request_id': 'req-f37d86ab-a9a3-425e-b8b7-f712239850a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:42.191045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32dbdd6518b145a8a4a1896190741f7e', 'request_id': 'req-f37d86ab-a9a3-425e-b8b7-f712239850a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:42.197952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32dbdd6518b145a8a4a1896190741f7e', 'request_id': 'req-f37d86ab-a9a3-425e-b8b7-f712239850a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:42.208656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] The token cache is being invalidate because project 32dbdd6518b145a8a4a1896190741f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:42.208952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:42.209612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f37d86ab-a9a3-425e-b8b7-f712239850a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:42.211182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 890/1745] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:41 2022] DELETE /identity/v3/projects/32dbdd6518b145a8a4a1896190741f7e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:42.216376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.216845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.217093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.247572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:42.248818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:42.306662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 856/1746] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:42.314740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.315034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.315319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.334862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:42.336255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:42.345138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 891/1747] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:42.349361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.359364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be31a3a-d3a6-490c-9316-5309a02eaf75 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:42.364699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:42.365361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.365645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.365925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.366656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:32:42.366964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:42.368603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.380416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 857/1748] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:32:42.385047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.394300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7c048-49d9-4b22-9629-a51c05646cb4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:42.399219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:42.399874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.400158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.400457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.401174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:42.403666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.494485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 892/1749] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:32:42.498948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.509005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8f01-c24a-41bc-87b1-b489d050a95a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:42.564842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:42.565470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.565755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.566031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.566741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:42.568711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.645841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 858/1750] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:42 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:42.646999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.657748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8fe28-371c-4450-a6e6-7c65895c9282 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:42.662753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:42.663470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.663756 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.664038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.664809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:42.666412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.677933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 893/1751] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:42.683449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.693216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a543-996e-4afc-92c9-4f3657f32b83 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:42.697818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f650a-3012-4a1f-a46b-da599ab01df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:42.698466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f650a-3012-4a1f-a46b-da599ab01df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.698750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f650a-3012-4a1f-a46b-da599ab01df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.699025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f650a-3012-4a1f-a46b-da599ab01df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.699743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f650a-3012-4a1f-a46b-da599ab01df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:42.701934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f650a-3012-4a1f-a46b-da599ab01df5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.711423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 859/1752] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:42.715336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.725692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8df0a-8583-4206-981e-8615c6a09473 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:42.730274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:42.731208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.731495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.731773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] PATH_INFO: `/v3/projects/842d5da21ad64b4abb76b93034f4df1a/users/cc15e02afa984537bf1c93accc1879c5/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.745785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] RBAC: Authorizing `identity:create_grant(project_id=842d5da21ad64b4abb76b93034f4df1a, user_id=cc15e02afa984537bf1c93accc1879c5, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:42.748527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:42.832069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 894/1753] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:42 2022] PUT /identity/v3/projects/842d5da21ad64b4abb76b93034f4df1a/users/cc15e02afa984537bf1c93accc1879c5/roles/246514336b4549609174329cae41663a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:42.843935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:42.844217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:42.844519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:42.871532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] MFA Rules not processed for user `cc15e02afa984537bf1c93accc1879c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:42.872766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:42.935945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 860/1754] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:42.946048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:42.947780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:43.001742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0facfa-deb8-4bcd-bcee-327e9c60024b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:43.005313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2d7d-7137-4969-b599-eaada811afc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:43.005944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2d7d-7137-4969-b599-eaada811afc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:43.006223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2d7d-7137-4969-b599-eaada811afc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:43.006495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2d7d-7137-4969-b599-eaada811afc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:43.015431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a2d7d-7137-4969-b599-eaada811afc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:43.016888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a2d7d-7137-4969-b599-eaada811afc1 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:43.025267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 895/1755] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:43.044252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:43.102631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889be3-b485-4275-906e-cd8cc3b59cf5 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:43.107668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:43.108581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:43.108870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:43.109145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] PATH_INFO: `/v3/users/cc15e02afa984537bf1c93accc1879c5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:43.110340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc15e02afa984537bf1c93accc1879c5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:43.112341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:43.272234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc15e02afa984537bf1c93accc1879c5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:43.273062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc15e02afa984537bf1c93accc1879c5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:43.280703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc15e02afa984537bf1c93accc1879c5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:43.292067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc15e02afa984537bf1c93accc1879c5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:43.292840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc15e02afa984537bf1c93accc1879c5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:43.361751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 861/1756] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:43 2022] DELETE /identity/v3/users/cc15e02afa984537bf1c93accc1879c5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:43.366281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:43.366597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:43.366907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:43.385183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:43.386381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:43.445271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 896/1757] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:43.455515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:43.456937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:43.511875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524db-32ab-41b6-8c5c-9381789c970e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:43.518710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a756d-9052-4a53-8733-2b8e2313d62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:43.518710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a756d-9052-4a53-8733-2b8e2313d62c service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:43.518710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a756d-9052-4a53-8733-2b8e2313d62c service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:43.518710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a756d-9052-4a53-8733-2b8e2313d62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:43.526376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a756d-9052-4a53-8733-2b8e2313d62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:43.527794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a756d-9052-4a53-8733-2b8e2313d62c service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:43.537657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 862/1758] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:44.141394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.142819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:44.154747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfe5c4-1556-42d5-8f32-55624d969809 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.159683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.160564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.160847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.161162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] PATH_INFO: `/v3/projects/842d5da21ad64b4abb76b93034f4df1a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.162506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842d5da21ad64b4abb76b93034f4df1a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.166062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.247635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842d5da21ad64b4abb76b93034f4df1a', 'request_id': 'req-c94354c0-516b-4351-b7f4-16fd4f258e90'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:44.293515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842d5da21ad64b4abb76b93034f4df1a', 'request_id': 'req-c94354c0-516b-4351-b7f4-16fd4f258e90'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:44.300701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842d5da21ad64b4abb76b93034f4df1a', 'request_id': 'req-c94354c0-516b-4351-b7f4-16fd4f258e90'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:44.311475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] The token cache is being invalidate because project 842d5da21ad64b4abb76b93034f4df1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:44.311828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:44.312504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-c94354c0-516b-4351-b7f4-16fd4f258e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:44.314269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 897/1759] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:44 2022] DELETE /identity/v3/projects/842d5da21ad64b4abb76b93034f4df1a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:44.318913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.319367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.319470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.336478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:44.337906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:44.396511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 863/1760] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:44.404539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.404840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.405118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.426303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:44.427659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:44.441141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 898/1761] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:44.442229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.451956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee8e4a-ebfd-4e7c-8d6b-ef3be4aac697 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.456755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.457518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.457805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.458083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.458811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:32:44.459116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.460728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.472747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 864/1762] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:32:44.481757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.490959 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb9e8c-a28b-4c8c-85b5-6cb76c9b0d14 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.495677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.496379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.496751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.497539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.498298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.500171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.590356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 899/1763] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:32:44 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:44.592138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.602091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde69ca-7bba-4fdb-98d9-b75db5866b65 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.659785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.660539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.660820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.661089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.661780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.663680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.783750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 865/1764] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:32:44 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:32:44.784862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.795477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c81d9a-ad50-4044-8b22-4a2758788ace admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.800541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.801232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.801566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.801878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.807042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.807042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.814739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 900/1765] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:32:44.818642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.828863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4412fb-e94c-4725-997f-4e6b28f43abc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.834198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8c42-1093-4b37-a311-db0b88491bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.834860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8c42-1093-4b37-a311-db0b88491bce admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.841059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8c42-1093-4b37-a311-db0b88491bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.841059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8c42-1093-4b37-a311-db0b88491bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.841059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8c42-1093-4b37-a311-db0b88491bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.841059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8c42-1093-4b37-a311-db0b88491bce admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.849583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 866/1766] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:32:44.853559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:44.868995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf7a3-6c72-47a5-a8ef-13284d2b577a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:44.873679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:44.875917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.875917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.875917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] PATH_INFO: `/v3/projects/b8074d3daf6545879ca691238056e5bb/users/5302fc5ea1a04d45b613630277c186f7/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:44.895155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8074d3daf6545879ca691238056e5bb, user_id=5302fc5ea1a04d45b613630277c186f7, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:44.897924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:44.983775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 901/1767] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:32:44 2022] PUT /identity/v3/projects/b8074d3daf6545879ca691238056e5bb/users/5302fc5ea1a04d45b613630277c186f7/roles/246514336b4549609174329cae41663a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:32:44.995209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4964d-cb20-4bb9-883c-4c9fce99ca65 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:44.995585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4964d-cb20-4bb9-883c-4c9fce99ca65 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:44.995926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4964d-cb20-4bb9-883c-4c9fce99ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:45.022680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-14b4964d-cb20-4bb9-883c-4c9fce99ca65 None None] MFA Rules not processed for user `5302fc5ea1a04d45b613630277c186f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:45.023919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-14b4964d-cb20-4bb9-883c-4c9fce99ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:45.111232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 867/1768] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:45.123434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:45.125207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:45.209751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b49c2-4ef5-414a-be3b-424da12e631a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:45.212731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad3b96-2b49-4d62-8698-e07000a1f430 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:45.213390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b96-2b49-4d62-8698-e07000a1f430 service glance] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:45.213859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b96-2b49-4d62-8698-e07000a1f430 service glance] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:45.214142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b96-2b49-4d62-8698-e07000a1f430 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:45.223494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad3b96-2b49-4d62-8698-e07000a1f430 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:45.225233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad3b96-2b49-4d62-8698-e07000a1f430 service glance] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:45.235525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 902/1769] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:55.182121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3fefb-560c-4123-8432-9734c3913297 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:55.186031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3fefb-560c-4123-8432-9734c3913297 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:55.186581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3fefb-560c-4123-8432-9734c3913297 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:55.190921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 868/1770] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:32:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:32:55.206762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:55.209124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:55.209124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:55.231947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:55.231947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:55.333671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 903/1771] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:55.350354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3fefb-560c-4123-8432-9734c3913297 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:55.352413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-85d3fefb-560c-4123-8432-9734c3913297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:55.370372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3fefb-560c-4123-8432-9734c3913297 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:55.377116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129bc4-e08e-4edf-9c4b-8fad84f4b6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:55.377965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129bc4-e08e-4edf-9c4b-8fad84f4b6f5 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:55.378406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129bc4-e08e-4edf-9c4b-8fad84f4b6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:55.378775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129bc4-e08e-4edf-9c4b-8fad84f4b6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:55.390969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129bc4-e08e-4edf-9c4b-8fad84f4b6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:55.395703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129bc4-e08e-4edf-9c4b-8fad84f4b6f5 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:55.407071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 869/1772] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:58.713227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:58.714651 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:58.780666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211320c-538b-4e3f-868d-987282f8c30f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:58.785248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:58.786142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:58.786400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:58.786699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] PATH_INFO: `/v3/users/d7b26021eb6143adb28da194f2d10b1e` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:58.787862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b26021eb6143adb28da194f2d10b1e)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:58.789889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:58.981045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b26021eb6143adb28da194f2d10b1e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:58.989736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b26021eb6143adb28da194f2d10b1e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.003231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b26021eb6143adb28da194f2d10b1e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.077593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b26021eb6143adb28da194f2d10b1e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.078227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b26021eb6143adb28da194f2d10b1e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.086515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 904/1773] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:58 2022] DELETE /identity/v3/users/d7b26021eb6143adb28da194f2d10b1e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:59.093187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e034e-9a19-4940-935e-663816136ca6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:59.093671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e034e-9a19-4940-935e-663816136ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:59.093762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e034e-9a19-4940-935e-663816136ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:59.114627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-831e034e-9a19-4940-935e-663816136ca6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:59.116181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-831e034e-9a19-4940-935e-663816136ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:59.190058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 870/1774] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:59.203565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:59.205375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:59.265793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6597ee2-0b31-4097-9ba7-392e00d7c119 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:59.269666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:59.270320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:59.270606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:59.270879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:59.281385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:59.282812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:59.292734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 905/1775] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:59.689606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e034e-9a19-4940-935e-663816136ca6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:59.691961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-831e034e-9a19-4940-935e-663816136ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:59.722959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e034e-9a19-4940-935e-663816136ca6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:59.742114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:59.742876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:59.743140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:59.743421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] PATH_INFO: `/v3/projects/bcd999dab8754ac6b709236c3d74eada` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:59.744696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd999dab8754ac6b709236c3d74eada)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:59.746602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:59.855306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd999dab8754ac6b709236c3d74eada', 'request_id': 'req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.861406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd999dab8754ac6b709236c3d74eada', 'request_id': 'req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.866861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd999dab8754ac6b709236c3d74eada', 'request_id': 'req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.927173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] The token cache is being invalidate because project bcd999dab8754ac6b709236c3d74eada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:32:59.927740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.928391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:32:59.930321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 871/1776] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:32:59 2022] DELETE /identity/v3/projects/bcd999dab8754ac6b709236c3d74eada => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:32:59.934269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:59.949000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83404e56-6669-4f37-acb0-9ec8ab836cdd service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:00.016352 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:00.017260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:00.017541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:00.017814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] PATH_INFO: `/v3/users/740afcf8466f41a58c8b41a56fdc58c1` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:00.018992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] RBAC: Authorizing `identity:delete_user(user_id=740afcf8466f41a58c8b41a56fdc58c1)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:00.020954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:00.209722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740afcf8466f41a58c8b41a56fdc58c1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.218264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740afcf8466f41a58c8b41a56fdc58c1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.232996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740afcf8466f41a58c8b41a56fdc58c1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.305150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740afcf8466f41a58c8b41a56fdc58c1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.306450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9b8a7f19-9166-4ff4-b5d1-711dab8b704f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740afcf8466f41a58c8b41a56fdc58c1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.321598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 906/1777] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:32:59 2022] DELETE /identity/v3/users/740afcf8466f41a58c8b41a56fdc58c1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:00.747358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:00.749757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:00.763431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca931-b9bc-4252-bacd-1084c5d6dfcf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:00.829056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:00.829918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:00.830194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:00.830465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] PATH_INFO: `/v3/projects/0607f40c8b3141658d4103d5d13783c0` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:00.831756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0607f40c8b3141658d4103d5d13783c0)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:00.833801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:00.928591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0607f40c8b3141658d4103d5d13783c0', 'request_id': 'req-5f13129b-014b-4612-9aa6-3cc41a674a47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.934585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0607f40c8b3141658d4103d5d13783c0', 'request_id': 'req-5f13129b-014b-4612-9aa6-3cc41a674a47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:00.940859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0607f40c8b3141658d4103d5d13783c0', 'request_id': 'req-5f13129b-014b-4612-9aa6-3cc41a674a47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:01.033842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] The token cache is being invalidate because project 0607f40c8b3141658d4103d5d13783c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:01.034495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:01.036607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5f13129b-014b-4612-9aa6-3cc41a674a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:01.038518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 872/1778] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:00 2022] DELETE /identity/v3/projects/0607f40c8b3141658d4103d5d13783c0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:01.043394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.044550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.045500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.066779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:01.068275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:01.160194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 907/1779] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:01.162375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.162728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.163120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.185507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:01.186850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:01.198595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 873/1780] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:01.202938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.213178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066e7f6-8fc6-46e5-a77e-bf7a714ce4b7 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.218557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.219322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.219699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.220046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.220904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:01.221216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.223207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.242302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 908/1781] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:01.243459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.253565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675ad83-dfe6-4f5f-b9ff-c20291ac5e1e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.258652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.261210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.261210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.261210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.261210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.262496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.343352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 874/1782] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:01.347836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.358776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f8b7-044a-4f47-9a87-b4ba63cab6e1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.467008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.467816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.468159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.468543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.469519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.471569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.563438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 909/1783] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:01.568661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.582773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d310e-7213-44a8-a925-ab0b7ce37723 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.588575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.590040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.590040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.590040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.590670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.593631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.611453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 875/1784] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:01.611558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.622333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acf76d-0e16-4b27-836e-525429384c1c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.628578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f284fa-92d4-4243-8076-4ad73c922ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.629272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f284fa-92d4-4243-8076-4ad73c922ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.629553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f284fa-92d4-4243-8076-4ad73c922ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.629828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f284fa-92d4-4243-8076-4ad73c922ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.630552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f284fa-92d4-4243-8076-4ad73c922ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.632164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f284fa-92d4-4243-8076-4ad73c922ceb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.644807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 910/1785] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:01.648954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.661356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d16b2-c7e3-44d3-a899-7144e509a59e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.667654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.668996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.669285 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.670746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] PATH_INFO: `/v3/projects/bd14138252a447aaad286e115427e3de/users/ebae14ddd329411cbf55e5d06fd6e0ac/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.686738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd14138252a447aaad286e115427e3de, user_id=ebae14ddd329411cbf55e5d06fd6e0ac, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.690112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:01.773732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 876/1786] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:01 2022] PUT /identity/v3/projects/bd14138252a447aaad286e115427e3de/users/ebae14ddd329411cbf55e5d06fd6e0ac/roles/246514336b4549609174329cae41663a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:01.784971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.785481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.785764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.815506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] MFA Rules not processed for user `ebae14ddd329411cbf55e5d06fd6e0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:01.817715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:01.898356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 911/1787] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:01.902877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:01.964998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b95df-36db-4e57-a6b8-1cf363a3f8c3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:01.969590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:01.973254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:01.973254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:01.973254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:01.973254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:01.973587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.045007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 877/1788] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:01 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:02.048863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.064032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32e4b-f44a-4c73-8aac-e0becdaa7c30 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.121514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.122180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.122459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.123265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.123953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.126566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.230160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 912/1789] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:02 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:02.233004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.243463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a7796-d810-462e-b040-0e2b7a507dd7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.248812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.249479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.249765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.250042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.250767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.252367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.266462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 878/1790] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:02.267699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.277930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5c9e-7065-43fb-acd0-5a10f62be7a1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.283166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.284051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.284342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.284681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] PATH_INFO: `/v3/projects/7c0b1c09c4054d68b80c64f0fba71613/users/517706a595484a56bcf6028aad5b4b0f/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.300624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0b1c09c4054d68b80c64f0fba71613, user_id=517706a595484a56bcf6028aad5b4b0f, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.304232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.392230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 913/1791] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:02 2022] PUT /identity/v3/projects/7c0b1c09c4054d68b80c64f0fba71613/users/517706a595484a56bcf6028aad5b4b0f/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:02.396497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.408632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593521e-a40b-44a8-82ed-9640ccbeab2d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.485513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83270a41-c6a6-48b2-b210-c590907156cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.486117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83270a41-c6a6-48b2-b210-c590907156cb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.486477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83270a41-c6a6-48b2-b210-c590907156cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.486697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83270a41-c6a6-48b2-b210-c590907156cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.487416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83270a41-c6a6-48b2-b210-c590907156cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.489178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83270a41-c6a6-48b2-b210-c590907156cb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.500465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 879/1792] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:02.504554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.515725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57460752-e0ee-4cf3-8bbb-2f311e0d6add admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.521004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.526928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.526928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.526928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] PATH_INFO: `/v3/projects/7c0b1c09c4054d68b80c64f0fba71613/users/517706a595484a56bcf6028aad5b4b0f/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.526928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0b1c09c4054d68b80c64f0fba71613, user_id=517706a595484a56bcf6028aad5b4b0f, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.527501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.538865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 914/1793] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:02 2022] PUT /identity/v3/projects/7c0b1c09c4054d68b80c64f0fba71613/users/517706a595484a56bcf6028aad5b4b0f/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:02.550553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.550984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.551298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.582144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] MFA Rules not processed for user `517706a595484a56bcf6028aad5b4b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:02.583479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:02.683095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 880/1794] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:02.693946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.695674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:02.759152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1e130-fe91-414c-b10f-d951be8aa584 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.762873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5092-ac1e-44b4-ab3e-5f92517e2e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.763536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5092-ac1e-44b4-ab3e-5f92517e2e3f service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.763817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5092-ac1e-44b4-ab3e-5f92517e2e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.764101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5092-ac1e-44b4-ab3e-5f92517e2e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.773413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f5092-ac1e-44b4-ab3e-5f92517e2e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.774858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f5092-ac1e-44b4-ab3e-5f92517e2e3f service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:02.789308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 915/1795] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:02.837668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:02.920538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a59576-7738-4a3d-af56-44338dfe6ead None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:02.926504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:02.928033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:02.928326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:02.934003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] PATH_INFO: `/v3/users/ebae14ddd329411cbf55e5d06fd6e0ac` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:02.935620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebae14ddd329411cbf55e5d06fd6e0ac)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:02.937784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:03.148237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebae14ddd329411cbf55e5d06fd6e0ac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:03.148939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebae14ddd329411cbf55e5d06fd6e0ac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:03.156890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebae14ddd329411cbf55e5d06fd6e0ac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:03.173204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebae14ddd329411cbf55e5d06fd6e0ac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:03.173951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebae14ddd329411cbf55e5d06fd6e0ac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:03.242833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 881/1796] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:02 2022] DELETE /identity/v3/users/ebae14ddd329411cbf55e5d06fd6e0ac => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:03.248386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d90d1-9098-4576-803d-bb9660244389 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:03.248899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d90d1-9098-4576-803d-bb9660244389 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:03.249088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d90d1-9098-4576-803d-bb9660244389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:03.268048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-072d90d1-9098-4576-803d-bb9660244389 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:03.269211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-072d90d1-9098-4576-803d-bb9660244389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:03.329490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 916/1797] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:03.338749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:03.340490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:03.402713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641932df-585a-4978-99e6-c6915e225092 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:03.406813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:03.407506 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:03.407791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:03.408061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:03.435894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:03.437972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:03.448811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 882/1798] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:03.906898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d90d1-9098-4576-803d-bb9660244389 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:03.908350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-072d90d1-9098-4576-803d-bb9660244389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:03.920863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d90d1-9098-4576-803d-bb9660244389 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:03.927146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:03.928062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:03.928351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:03.928754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] PATH_INFO: `/v3/projects/bd14138252a447aaad286e115427e3de` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:03.930338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd14138252a447aaad286e115427e3de)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:03.932374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:04.060235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd14138252a447aaad286e115427e3de', 'request_id': 'req-5a585589-d9df-486a-9804-a8d0c26a5a1a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.132201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd14138252a447aaad286e115427e3de', 'request_id': 'req-5a585589-d9df-486a-9804-a8d0c26a5a1a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.140129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd14138252a447aaad286e115427e3de', 'request_id': 'req-5a585589-d9df-486a-9804-a8d0c26a5a1a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.154771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] The token cache is being invalidate because project bd14138252a447aaad286e115427e3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:04.155214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.156121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.158029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 917/1799] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:03 2022] DELETE /identity/v3/projects/bd14138252a447aaad286e115427e3de => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:04.166088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:04.173089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b5b9-7b73-43b3-824f-eb5b0c25a6ed service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:04.242270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:04.243335 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:04.243627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:04.243954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] PATH_INFO: `/v3/users/517706a595484a56bcf6028aad5b4b0f` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:04.245172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=517706a595484a56bcf6028aad5b4b0f)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:04.247411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:04.433617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517706a595484a56bcf6028aad5b4b0f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.434384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517706a595484a56bcf6028aad5b4b0f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.441582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517706a595484a56bcf6028aad5b4b0f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.459144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517706a595484a56bcf6028aad5b4b0f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.460043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e27415f0-99e1-49a3-a3ea-18ba3bf0b5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517706a595484a56bcf6028aad5b4b0f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:04.538933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 883/1800] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:04 2022] DELETE /identity/v3/users/517706a595484a56bcf6028aad5b4b0f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:05.215106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:05.217180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:05.232300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a585589-d9df-486a-9804-a8d0c26a5a1a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:05.305894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:05.306754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:05.307037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:05.307312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] PATH_INFO: `/v3/projects/7c0b1c09c4054d68b80c64f0fba71613` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:05.308565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0b1c09c4054d68b80c64f0fba71613)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:05.311170 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:05.451201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0b1c09c4054d68b80c64f0fba71613', 'request_id': 'req-854a9d07-8618-40c3-bd57-00e618f5625e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:05.511851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0b1c09c4054d68b80c64f0fba71613', 'request_id': 'req-854a9d07-8618-40c3-bd57-00e618f5625e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:05.520147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0b1c09c4054d68b80c64f0fba71613', 'request_id': 'req-854a9d07-8618-40c3-bd57-00e618f5625e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:05.539450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] The token cache is being invalidate because project 7c0b1c09c4054d68b80c64f0fba71613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:05.539450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:05.539956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-854a9d07-8618-40c3-bd57-00e618f5625e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:05.548878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:05.549419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:05.549419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:05.558836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 918/1801] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:05 2022] DELETE /identity/v3/projects/7c0b1c09c4054d68b80c64f0fba71613 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:05.571624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:05.573678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:05.644795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 884/1802] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:05.653290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:05.654344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:05.654692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:05.684153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:05.686013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:05.695605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 919/1803] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:05.699895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:05.709470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9404-276d-4523-9661-75b5d85c1e4f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:05.714100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:05.714749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:05.715033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:05.715311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:05.716027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:05.716960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:05.718628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:05.735525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 885/1804] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:05.737657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:05.747072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb743e-caa2-4100-bbe6-34d8dc2d145d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:05.751980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:05.752696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:05.752984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:05.753262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:05.753960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:05.755929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:05.901026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 920/1805] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:05 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:05.913375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:05.924079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa38c6-1eca-4655-9381-f859b302c892 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:05.985841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:05.986449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:05.986734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:05.987010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:05.987722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:05.989710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.157525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 886/1806] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:05 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:06.162254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.174784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2c1ec-f8e6-4774-b0b6-ce537d5927a7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.195294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.196215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.196729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.197220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.197961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.199635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.211399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 921/1807] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:06.215340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.226225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5dec9-357b-4834-b1b9-59c7aef72843 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.237571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be99aef-6dbc-475a-892a-c2372e23018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.238781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99aef-6dbc-475a-892a-c2372e23018d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.239110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99aef-6dbc-475a-892a-c2372e23018d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.239416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99aef-6dbc-475a-892a-c2372e23018d admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.240165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be99aef-6dbc-475a-892a-c2372e23018d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.241822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be99aef-6dbc-475a-892a-c2372e23018d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.264878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 887/1808] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:06.269262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.283397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52b7dc-bc5c-4ac6-a5e1-b179a94084c4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.288691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.289829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.290363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.290864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] PATH_INFO: `/v3/projects/06ab129e62484eaf82f5e8e922e31e4c/users/ef5639d2a2a340a69cee75955901c4ce/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.307879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ab129e62484eaf82f5e8e922e31e4c, user_id=ef5639d2a2a340a69cee75955901c4ce, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.312334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.384596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 922/1809] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:06 2022] PUT /identity/v3/projects/06ab129e62484eaf82f5e8e922e31e4c/users/ef5639d2a2a340a69cee75955901c4ce/roles/246514336b4549609174329cae41663a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:06.395954 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.396268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.396557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.428081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] MFA Rules not processed for user `ef5639d2a2a340a69cee75955901c4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:06.429858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:06.518357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 888/1810] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:06.523055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.593548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d0ea-c011-44c0-bfb6-ffc1fbeccb6b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.598522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.599188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.599472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.599751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.600519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.602402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.715721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 923/1811] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:06 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:06.716942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.727526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac97e57-a915-467c-b65a-7991518ab95a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.783358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.784032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.784318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.784621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.785313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.787230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.886903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 889/1812] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:06 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:06.890633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.900642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044e11-93a8-4460-9f09-88ff1501ac7f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.905414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.906080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.906361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.906666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.907397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.909267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:06.929025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 924/1813] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:06.932554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:06.943748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e53c10-7fad-4765-aece-677574c551f7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:06.948519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:06.949397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:06.949674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:06.949943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] PATH_INFO: `/v3/projects/59f7fcf561f54c4d80ecd286dcefbcb0/users/ad9731455a304e3ca1dd7da3dbaea672/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:06.965318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f7fcf561f54c4d80ecd286dcefbcb0, user_id=ad9731455a304e3ca1dd7da3dbaea672, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:06.968024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:07.029314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 890/1814] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:06 2022] PUT /identity/v3/projects/59f7fcf561f54c4d80ecd286dcefbcb0/users/ad9731455a304e3ca1dd7da3dbaea672/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:07.032896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:07.053582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35906d-fc7d-48b1-9e29-b9d14810de01 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:07.125000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebfb38-8276-4540-9f8b-cba904a10833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:07.129453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebfb38-8276-4540-9f8b-cba904a10833 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:07.129453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebfb38-8276-4540-9f8b-cba904a10833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:07.129453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebfb38-8276-4540-9f8b-cba904a10833 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:07.129453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebfb38-8276-4540-9f8b-cba904a10833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:07.129453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebfb38-8276-4540-9f8b-cba904a10833 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:07.140061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 925/1815] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:07.144019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:07.171287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fa479-b2a8-4607-be59-f0b2c7f22aff admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:07.178552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:07.178552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:07.178552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:07.178552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] PATH_INFO: `/v3/projects/59f7fcf561f54c4d80ecd286dcefbcb0/users/ad9731455a304e3ca1dd7da3dbaea672/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:07.179688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f7fcf561f54c4d80ecd286dcefbcb0, user_id=ad9731455a304e3ca1dd7da3dbaea672, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:07.182539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:07.194603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 891/1816] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:07 2022] PUT /identity/v3/projects/59f7fcf561f54c4d80ecd286dcefbcb0/users/ad9731455a304e3ca1dd7da3dbaea672/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:07.207416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:07.207416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:07.207416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:07.239243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] MFA Rules not processed for user `ad9731455a304e3ca1dd7da3dbaea672`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:07.240575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:07.317123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 926/1817] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:07.331697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:07.334996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:07.408073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987cff-fe39-4934-8e86-4d3e46eaa41b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:07.411963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:07.412824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:07.412983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:07.413255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:07.422957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:07.424420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:07.434074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 892/1818] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:08.515143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:08.529735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7580b1f-11b1-4eff-b04c-e073c1ca583b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:08.540873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9731455a304e3ca1dd7da3dbaea672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59f7fcf561f54c4d80ecd286dcefbcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:08.542017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:08.542527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:08.543043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:08.544947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:08.545721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:08.548789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:08.564462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 927/1819] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:08.566288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:08.575955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad28a2-2e96-44b7-adf6-8296bd905c03 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:08.580955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9731455a304e3ca1dd7da3dbaea672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59f7fcf561f54c4d80ecd286dcefbcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:08.581630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:08.581914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:08.582183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:08.582892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:08.584852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:08.765281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 893/1820] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:08 2022] POST /identity/v3/projects => generated 354 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:08.767000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:08.777942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f765-9491-4ff2-8c4d-025ce313edfe tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:08.850381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9731455a304e3ca1dd7da3dbaea672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59f7fcf561f54c4d80ecd286dcefbcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:08.852017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:08.852017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:08.852017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:08.853171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:08.853171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:08.854433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:08.868778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 928/1821] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:08.909908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:08.920809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a32682-8257-4932-aefc-2d9d9214e681 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:08.926007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9731455a304e3ca1dd7da3dbaea672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59f7fcf561f54c4d80ecd286dcefbcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:08.927012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:08.927493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:08.927852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] PATH_INFO: `/v3/projects/eeec6da43089465e84e688d8b85e2bc1` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:08.929038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eeec6da43089465e84e688d8b85e2bc1)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:08.930985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:09.026234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeec6da43089465e84e688d8b85e2bc1', 'request_id': 'req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:09.034127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeec6da43089465e84e688d8b85e2bc1', 'request_id': 'req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:09.040550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeec6da43089465e84e688d8b85e2bc1', 'request_id': 'req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:09.093589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] The token cache is being invalidate because project eeec6da43089465e84e688d8b85e2bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:09.093957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:09.094583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4995d692-67aa-4fbe-80ae-fc8c51bdc6d5 tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:09.096160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 894/1822] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:08 2022] DELETE /identity/v3/projects/eeec6da43089465e84e688d8b85e2bc1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:09.705276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:09.707124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:09.772299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301926-53ef-45c9-8f25-f850a1f92d9d tempest-VolumeQuotaClassesTest-1820126940 tempest-VolumeQuotaClassesTest-1820126940-project-admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:09.831267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:09.833330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:09.833330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:09.833330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] PATH_INFO: `/v3/users/ef5639d2a2a340a69cee75955901c4ce` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:09.834291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5639d2a2a340a69cee75955901c4ce)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:09.836403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:10.064828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5639d2a2a340a69cee75955901c4ce'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.071251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5639d2a2a340a69cee75955901c4ce'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.082544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5639d2a2a340a69cee75955901c4ce'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.160593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5639d2a2a340a69cee75955901c4ce'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.161232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5639d2a2a340a69cee75955901c4ce'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.167465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 929/1823] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:09 2022] DELETE /identity/v3/users/ef5639d2a2a340a69cee75955901c4ce => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:10.172696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:10.173163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:10.173466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:10.189950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:10.191148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:10.251066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 895/1824] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:10.261100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:10.262527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:10.323810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578977a-e8d0-4857-9fe8-ee74e669a15e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:10.327354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:10.327993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:10.328275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:10.328592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:10.337583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:10.346825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:10.348837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 930/1825] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:10.762679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:10.764677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:10.776139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322ca7-cbda-45cb-b17a-b756739e33be None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:10.781138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:10.782459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:10.782852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:10.783132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] PATH_INFO: `/v3/projects/06ab129e62484eaf82f5e8e922e31e4c` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:10.785041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ab129e62484eaf82f5e8e922e31e4c)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:10.787148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:10.904672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ab129e62484eaf82f5e8e922e31e4c', 'request_id': 'req-58facefc-4199-4493-8676-ca8d57eb9efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.910881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ab129e62484eaf82f5e8e922e31e4c', 'request_id': 'req-58facefc-4199-4493-8676-ca8d57eb9efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.916351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ab129e62484eaf82f5e8e922e31e4c', 'request_id': 'req-58facefc-4199-4493-8676-ca8d57eb9efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.988384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] The token cache is being invalidate because project 06ab129e62484eaf82f5e8e922e31e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:10.988732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.989350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:10.990899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 896/1826] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:10 2022] DELETE /identity/v3/projects/06ab129e62484eaf82f5e8e922e31e4c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:10.994865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:11.004388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0837b2-c5d5-4cd6-be88-0296861fc990 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:11.059229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:11.060680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:11.060960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:11.061234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] PATH_INFO: `/v3/users/ad9731455a304e3ca1dd7da3dbaea672` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:11.062427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9731455a304e3ca1dd7da3dbaea672)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:11.064404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:11.238016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9731455a304e3ca1dd7da3dbaea672'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:11.244582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9731455a304e3ca1dd7da3dbaea672'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:11.257623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9731455a304e3ca1dd7da3dbaea672'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:11.333506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9731455a304e3ca1dd7da3dbaea672'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:11.333958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ae3c6e9e-dbd9-4259-8381-5d89d010deb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9731455a304e3ca1dd7da3dbaea672'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:11.340139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 931/1827] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:10 2022] DELETE /identity/v3/users/ad9731455a304e3ca1dd7da3dbaea672 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:11.786215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:11.787677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:11.800231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58facefc-4199-4493-8676-ca8d57eb9efc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:11.855697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:11.856580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:11.856857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:11.857126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] PATH_INFO: `/v3/projects/59f7fcf561f54c4d80ecd286dcefbcb0` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:11.858284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f7fcf561f54c4d80ecd286dcefbcb0)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:11.860178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.024325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f7fcf561f54c4d80ecd286dcefbcb0', 'request_id': 'req-6fa25fc5-9414-4163-9c50-7176824f9d18'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:12.030244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f7fcf561f54c4d80ecd286dcefbcb0', 'request_id': 'req-6fa25fc5-9414-4163-9c50-7176824f9d18'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:12.035410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f7fcf561f54c4d80ecd286dcefbcb0', 'request_id': 'req-6fa25fc5-9414-4163-9c50-7176824f9d18'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:12.092202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] The token cache is being invalidate because project 59f7fcf561f54c4d80ecd286dcefbcb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:12.092521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:12.093144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6fa25fc5-9414-4163-9c50-7176824f9d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:12.094796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 897/1828] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:11 2022] DELETE /identity/v3/projects/59f7fcf561f54c4d80ecd286dcefbcb0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:12.099717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.102719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.102719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.118119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:12.119311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:12.175552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 932/1829] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:12.183153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.183442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.183726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.202383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:12.203576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:12.211435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 898/1830] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:12.215787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.225794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d3cd9-0ff3-44de-b2c5-2c8d6bb9953e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.230418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.231237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.232028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.232315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.233085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:12.233395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.235003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.246575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 933/1831] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:12.251543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.260985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0572012-4dc3-4504-9fe6-adc20c3b7564 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.265707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.266895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.266895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.266895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.267707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.269645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.379682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 899/1832] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:12.383902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.393680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206d29a-edf6-4a48-8ff3-0bc7fbbdc0a6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.447160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.447732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.448012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.448286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.448996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.450906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.516199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 934/1833] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:12.520398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.531024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d83c-fbcc-4c8b-add3-f930b4fb2457 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.535997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.536682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.536972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.537251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.537975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.539568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.550547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 900/1834] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:12.554844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.568186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04205-4b85-40fb-93d1-807acd32ffa3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.572926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34487d-27e5-424f-b45c-6db976b3ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.573714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34487d-27e5-424f-b45c-6db976b3ccbb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.574203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34487d-27e5-424f-b45c-6db976b3ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.574588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34487d-27e5-424f-b45c-6db976b3ccbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.575321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34487d-27e5-424f-b45c-6db976b3ccbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.576962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34487d-27e5-424f-b45c-6db976b3ccbb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.587055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 935/1835] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:12.592155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.601906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b5ec-8807-46f5-aefa-1a5d0b7de1ed admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.607233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.608099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.608383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.608688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] PATH_INFO: `/v3/projects/747b5b1850534efa922759c23b8f3ccc/users/42c6f92e75e946029ade425db5b67efc/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.622744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747b5b1850534efa922759c23b8f3ccc, user_id=42c6f92e75e946029ade425db5b67efc, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.625478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.691569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 901/1836] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:12 2022] PUT /identity/v3/projects/747b5b1850534efa922759c23b8f3ccc/users/42c6f92e75e946029ade425db5b67efc/roles/246514336b4549609174329cae41663a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:12.702317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.702555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.702857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.730491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] MFA Rules not processed for user `42c6f92e75e946029ade425db5b67efc`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:12.731633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:12.795787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 936/1837] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:12.800281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.858033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b834ab-5d0e-418f-a858-97bd23c37fe6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:12.862646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:12.863287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:12.863570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:12.863846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:12.864567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:12.866459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:12.969240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 902/1838] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/projects => generated 389 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:12.973269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:12.983905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667821-2989-4d87-880f-b3eb0c7afd19 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.038293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.039041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.039323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.039594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.040279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.042245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.127407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 937/1839] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:12 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:13.131588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:13.142765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce57c5-0842-4270-a806-4cd668046479 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.147764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.148436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.148736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.149023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.149801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.151382 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.161650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 903/1840] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:13.165685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:13.175064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c77d2-6212-40c3-a66b-a0db71529ddf admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.179658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.180539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.180821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.181093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] PATH_INFO: `/v3/projects/f75d974807a44032a81b762420fb1a5a/users/c4e1a759448f437eb648746e817b2065/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.196437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75d974807a44032a81b762420fb1a5a, user_id=c4e1a759448f437eb648746e817b2065, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.199165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.269109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 938/1841] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:13 2022] PUT /identity/v3/projects/f75d974807a44032a81b762420fb1a5a/users/c4e1a759448f437eb648746e817b2065/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:13.273022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:13.282594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c106-96c1-4076-9a15-a96cf258d5ee admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.337406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0222-9a8e-4e0a-b052-5fab28b31f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.338099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0222-9a8e-4e0a-b052-5fab28b31f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.338385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0222-9a8e-4e0a-b052-5fab28b31f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.338664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0222-9a8e-4e0a-b052-5fab28b31f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.339380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0222-9a8e-4e0a-b052-5fab28b31f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.341021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0222-9a8e-4e0a-b052-5fab28b31f00 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.353417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 904/1842] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:13.355081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:13.366075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd9f1-9567-47bc-ab11-9a1b2068bc89 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.370856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.371732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.372006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.372278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] PATH_INFO: `/v3/projects/f75d974807a44032a81b762420fb1a5a/users/c4e1a759448f437eb648746e817b2065/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.374875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75d974807a44032a81b762420fb1a5a, user_id=c4e1a759448f437eb648746e817b2065, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.377546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.387787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 939/1843] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:13 2022] PUT /identity/v3/projects/f75d974807a44032a81b762420fb1a5a/users/c4e1a759448f437eb648746e817b2065/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:13.399039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.399279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.399555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.426122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] MFA Rules not processed for user `c4e1a759448f437eb648746e817b2065`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:13.427475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:13.494253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 905/1844] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:13.504458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:13.506168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:13.560517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e3753-7536-4ef2-ab17-1389fbc40622 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.564698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5f36b-84df-4f91-9f95-c9dffe4f952e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.565337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f36b-84df-4f91-9f95-c9dffe4f952e service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.565623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f36b-84df-4f91-9f95-c9dffe4f952e service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.565901 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f36b-84df-4f91-9f95-c9dffe4f952e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.574705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5f36b-84df-4f91-9f95-c9dffe4f952e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.576133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5f36b-84df-4f91-9f95-c9dffe4f952e service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.585390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 940/1845] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:13.703159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:13.763693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c55a5-0c1d-4275-ab0d-68463ae5b194 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:13.768241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:13.769136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:13.769422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:13.769696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] PATH_INFO: `/v3/users/42c6f92e75e946029ade425db5b67efc` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:13.771005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c6f92e75e946029ade425db5b67efc)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:13.772958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:13.975027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c6f92e75e946029ade425db5b67efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:13.975684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c6f92e75e946029ade425db5b67efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:13.982177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c6f92e75e946029ade425db5b67efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:13.993937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c6f92e75e946029ade425db5b67efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:13.994578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c6f92e75e946029ade425db5b67efc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:14.080059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 906/1846] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:13 2022] DELETE /identity/v3/users/42c6f92e75e946029ade425db5b67efc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:14.088352 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:14.088742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:14.089093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:14.108110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:14.109395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:14.173099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 941/1847] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:14.183220 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:14.184691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:14.242330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f13b-504a-4c6e-be7d-7059f729fd4d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:14.245956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:14.246603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:14.246885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:14.247249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:14.256076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:14.257796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:14.267432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 907/1848] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:14.707357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:14.708943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:14.721203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e25b21-a386-4b10-a2a2-6684f53cb104 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:14.726160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:14.727013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:14.727299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:14.727576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] PATH_INFO: `/v3/projects/747b5b1850534efa922759c23b8f3ccc` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:14.728839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747b5b1850534efa922759c23b8f3ccc)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:14.730751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:14.843441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747b5b1850534efa922759c23b8f3ccc', 'request_id': 'req-112e4cdc-7e00-485f-bbe6-ac20e27415c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:14.916459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747b5b1850534efa922759c23b8f3ccc', 'request_id': 'req-112e4cdc-7e00-485f-bbe6-ac20e27415c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:14.922980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747b5b1850534efa922759c23b8f3ccc', 'request_id': 'req-112e4cdc-7e00-485f-bbe6-ac20e27415c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:14.933271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] The token cache is being invalidate because project 747b5b1850534efa922759c23b8f3ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:14.933563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:14.934203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:14.935763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 942/1849] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:14 2022] DELETE /identity/v3/projects/747b5b1850534efa922759c23b8f3ccc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:14.939675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:14.949143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d6b9-9dae-43fe-a7e7-e56268454fc6 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:15.005057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:15.005955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:15.006234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:15.006554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] PATH_INFO: `/v3/users/c4e1a759448f437eb648746e817b2065` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:15.008027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e1a759448f437eb648746e817b2065)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:15.009989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:15.157953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e1a759448f437eb648746e817b2065'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.158535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e1a759448f437eb648746e817b2065'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.164898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e1a759448f437eb648746e817b2065'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.175832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e1a759448f437eb648746e817b2065'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.176489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7b90df34-1d1e-4287-84d0-de89972a509d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e1a759448f437eb648746e817b2065'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.229589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 908/1850] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:14 2022] DELETE /identity/v3/users/c4e1a759448f437eb648746e817b2065 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:15.664928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:15.666456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:15.681342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e4cdc-7e00-485f-bbe6-ac20e27415c0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:15.746777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:15.747719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:15.748610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:15.748920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] PATH_INFO: `/v3/projects/f75d974807a44032a81b762420fb1a5a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:15.750141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75d974807a44032a81b762420fb1a5a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:15.752139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:15.854475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75d974807a44032a81b762420fb1a5a', 'request_id': 'req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.933570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75d974807a44032a81b762420fb1a5a', 'request_id': 'req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.946645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75d974807a44032a81b762420fb1a5a', 'request_id': 'req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.951799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] The token cache is being invalidate because project f75d974807a44032a81b762420fb1a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:15.952092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.952789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-12e856ad-95e6-4ab5-b641-5d9e4f2fc9cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:15.954633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 943/1851] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:15 2022] DELETE /identity/v3/projects/f75d974807a44032a81b762420fb1a5a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:15.959747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:15.960112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:15.960541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:15.978400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:15.979881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:16.038857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 909/1852] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:16.047052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.049421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.049421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.066164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:16.067347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:16.075274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 944/1853] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:16.079604 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.089057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ce2f6-43a1-4a89-b83d-3359957e8dfa None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.094209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.094861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.095143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.095447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.096173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:16.096515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.098107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.113766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 910/1854] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:16.115102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.124235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232b9b5-17c3-4331-8393-2d9078d4fae1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.129183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.129848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.130139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.130422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.131146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.133541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.249114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 945/1855] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:16 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:16.253142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.263167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd92b-6796-46d2-a180-78fc139621e4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.318490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.319172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.319436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.319705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.320416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.322547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.428979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 911/1856] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:16 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:16.433077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.443115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3906a-e80a-4ef5-be74-b814440b7525 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.448812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.449045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.449421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.449658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.450397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.452592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.463028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 946/1857] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:16.466997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.477653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc592a38-4d2a-4dd6-9d90-c18238b3ac3f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.482277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9a93-a792-47b5-867e-b0132c0b1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.482952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9a93-a792-47b5-867e-b0132c0b1d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.483319 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9a93-a792-47b5-867e-b0132c0b1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.483627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9a93-a792-47b5-867e-b0132c0b1d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.484448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e9a93-a792-47b5-867e-b0132c0b1d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.486062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e9a93-a792-47b5-867e-b0132c0b1d2b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.495856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 912/1858] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:16.500238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.510337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b94843-e63c-4cb0-9f62-5ba15960cdd1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.515609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.516501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.516791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.517076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] PATH_INFO: `/v3/projects/ff0c8134fc924517b7c8c0bf9f3dc0c3/users/690567cae0b14f61b501110bcd8ac06f/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.531531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c8134fc924517b7c8c0bf9f3dc0c3, user_id=690567cae0b14f61b501110bcd8ac06f, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.534298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.617477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 947/1859] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:16 2022] PUT /identity/v3/projects/ff0c8134fc924517b7c8c0bf9f3dc0c3/users/690567cae0b14f61b501110bcd8ac06f/roles/246514336b4549609174329cae41663a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:16.629376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.629687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.629966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.655530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] MFA Rules not processed for user `690567cae0b14f61b501110bcd8ac06f`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:16.656731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:16.719524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 913/1860] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:16.723925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.782689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ad628-5334-4a6a-bd6b-ccd4f7602a24 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.787240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.787886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.788173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.788479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.789199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.791107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:16.879910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 948/1861] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:16.882170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:16.894035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb534-79bc-4a85-990c-e034acc56798 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:16.958103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:16.959005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:16.959574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:16.959675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:16.960968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:16.962455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.030749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 914/1862] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:16 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:17.035600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.045662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8a9fc-f9c8-4b05-acf3-d1f048d3a080 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.050338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.050989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.051272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.051554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.052270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.053908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.064628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 949/1863] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:17.068621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.080990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec60974-5c2f-4586-9da0-a95f8b755a4a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.085928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31cc14-edd7-4484-81d8-132ae434d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.090969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31cc14-edd7-4484-81d8-132ae434d448 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.090969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31cc14-edd7-4484-81d8-132ae434d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.090969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31cc14-edd7-4484-81d8-132ae434d448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.090969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31cc14-edd7-4484-81d8-132ae434d448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.090969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31cc14-edd7-4484-81d8-132ae434d448 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.099870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 915/1864] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:17.104409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.115746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a9e1-553e-4b67-aa1d-2f427e1e9e34 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.120345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.121253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.121539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.121815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] PATH_INFO: `/v3/projects/76a0e307a7fb428eb8f3746809ee0d99/users/7f4fe2821dff437897d0f89b7b55625e/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.136731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a0e307a7fb428eb8f3746809ee0d99, user_id=7f4fe2821dff437897d0f89b7b55625e, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.139434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.208013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 950/1865] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:17 2022] PUT /identity/v3/projects/76a0e307a7fb428eb8f3746809ee0d99/users/7f4fe2821dff437897d0f89b7b55625e/roles/246514336b4549609174329cae41663a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:17.220114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.220406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.220712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.246739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] MFA Rules not processed for user `7f4fe2821dff437897d0f89b7b55625e`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:17.247945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:17.309472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 916/1866] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:17.314620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.382330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665614ac-1afb-448d-88bf-b920465b76a7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.387378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.388043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.388330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.388640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.389345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.391281 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.494782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 951/1867] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:17 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:17.498923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.509559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f47a5-69d8-406b-bfc6-818848de4e83 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.564473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.565069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.565359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.565637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.566322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.568234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.675317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 917/1868] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:17 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:17.679412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.689980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7de810-5d72-4264-8c9e-1e71ad32cfd6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.694653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.695307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.695589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.695866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.696652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.698254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.707900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 952/1869] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:17.712236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.723132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed440a-86cd-4bde-aea4-f0b67a778f1f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.728901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.728901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.728901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.729220 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] PATH_INFO: `/v3/projects/6c2f53a57af845ba9f149626c250dd5e/users/8e76c3c136614266b63e07e958214fcb/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.743835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2f53a57af845ba9f149626c250dd5e, user_id=8e76c3c136614266b63e07e958214fcb, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.746577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.812537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 918/1870] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:17 2022] PUT /identity/v3/projects/6c2f53a57af845ba9f149626c250dd5e/users/8e76c3c136614266b63e07e958214fcb/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:17.816600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.826473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bffe8-952e-4124-bd1c-d6ce44518159 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.883066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296d507-7502-4cca-a6f1-57e908d97121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.883785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296d507-7502-4cca-a6f1-57e908d97121 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.884062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296d507-7502-4cca-a6f1-57e908d97121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.884343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296d507-7502-4cca-a6f1-57e908d97121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.885099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296d507-7502-4cca-a6f1-57e908d97121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.886695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296d507-7502-4cca-a6f1-57e908d97121 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.896096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 953/1871] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:17.900416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.912292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2ca4-1b3e-4c68-9723-c7b47819256d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.918230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.919145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.919429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.919704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] PATH_INFO: `/v3/projects/6c2f53a57af845ba9f149626c250dd5e/users/8e76c3c136614266b63e07e958214fcb/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.922256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2f53a57af845ba9f149626c250dd5e, user_id=8e76c3c136614266b63e07e958214fcb, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.925071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.937260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 919/1872] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:17 2022] PUT /identity/v3/projects/6c2f53a57af845ba9f149626c250dd5e/users/8e76c3c136614266b63e07e958214fcb/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:17.946854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.947151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.947434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.979557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] MFA Rules not processed for user `8e76c3c136614266b63e07e958214fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:17.980859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:18.127120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 954/1873] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:18.127973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:18.127973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:18.161503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad062e4c-4cf7-408d-8de5-6e286b11c7b9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:18.165767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:18.166488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:18.166840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:18.167184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:18.177534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:18.179376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:18.190689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 920/1874] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:18.313612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:18.315055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:18.326635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0384-8789-45cd-9f76-bd4418e127b8 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:18.330190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766f56c-2bdc-43c2-81a6-0020d8e21d52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:18.330820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f56c-2bdc-43c2-81a6-0020d8e21d52 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:18.331104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f56c-2bdc-43c2-81a6-0020d8e21d52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:18.331380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f56c-2bdc-43c2-81a6-0020d8e21d52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:18.385677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766f56c-2bdc-43c2-81a6-0020d8e21d52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:18.387052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766f56c-2bdc-43c2-81a6-0020d8e21d52 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:18.395792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 955/1875] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:23.418158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:23.483976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7f4f-5d1d-4504-b006-39361f4ddb6b service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:23.488882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:23.493770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:23.493770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:23.493770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] PATH_INFO: `/v3/users/690567cae0b14f61b501110bcd8ac06f` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:23.493770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690567cae0b14f61b501110bcd8ac06f)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:23.493770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:23.728109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690567cae0b14f61b501110bcd8ac06f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:23.728898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690567cae0b14f61b501110bcd8ac06f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:23.735553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690567cae0b14f61b501110bcd8ac06f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:23.746878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690567cae0b14f61b501110bcd8ac06f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:23.747520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690567cae0b14f61b501110bcd8ac06f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:23.811810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 921/1876] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:23 2022] DELETE /identity/v3/users/690567cae0b14f61b501110bcd8ac06f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:23.816446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:23.816932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:23.817028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:23.834487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:23.835758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:23.893123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 956/1877] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:23.902818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:23.904199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:23.960126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897d78-47fc-4dae-9ca0-a52c599be398 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:23.963681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:23.964341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:23.964642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:23.964919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:23.974542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:23.976011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:23.986118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 922/1878] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:24.397970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:24.399420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:24.412774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc514849-ef76-4de9-a86e-e92f313a99fb None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:24.418146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:24.419272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:24.419770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:24.420244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] PATH_INFO: `/v3/projects/ff0c8134fc924517b7c8c0bf9f3dc0c3` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:24.422338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0c8134fc924517b7c8c0bf9f3dc0c3)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:24.426955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:24.546306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0c8134fc924517b7c8c0bf9f3dc0c3', 'request_id': 'req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.630723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0c8134fc924517b7c8c0bf9f3dc0c3', 'request_id': 'req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.638300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0c8134fc924517b7c8c0bf9f3dc0c3', 'request_id': 'req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.650106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] The token cache is being invalidate because project ff0c8134fc924517b7c8c0bf9f3dc0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:24.653547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.653547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ff0f0fa6-5019-432f-b9cd-f56bcefbf2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.653547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 957/1879] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:24 2022] DELETE /identity/v3/projects/ff0c8134fc924517b7c8c0bf9f3dc0c3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:24.657482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:24.667983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29121d8d-6bf3-4ded-bedb-47735580ecd2 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:24.728714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:24.729581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:24.729863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:24.730137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] PATH_INFO: `/v3/users/7f4fe2821dff437897d0f89b7b55625e` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:24.731317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4fe2821dff437897d0f89b7b55625e)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:24.735347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:24.877869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4fe2821dff437897d0f89b7b55625e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.878525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4fe2821dff437897d0f89b7b55625e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.885795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4fe2821dff437897d0f89b7b55625e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.897871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4fe2821dff437897d0f89b7b55625e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.898554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4fe2821dff437897d0f89b7b55625e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:24.956405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 923/1880] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:24 2022] DELETE /identity/v3/users/7f4fe2821dff437897d0f89b7b55625e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:25.198054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:25.198519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:25.204178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:25.236706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] MFA Rules not processed for user `35d4828335a543758d1413c0276657a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:25.237920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:25.300004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 958/1881] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:25.432156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:25.433596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:25.511990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fc2f-fe20-470f-8399-8c4c880d191e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:25.517117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:25.517977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:25.518255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:25.518554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] PATH_INFO: `/v3/projects/76a0e307a7fb428eb8f3746809ee0d99` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:25.519942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a0e307a7fb428eb8f3746809ee0d99)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:25.521876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:25.638475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a0e307a7fb428eb8f3746809ee0d99', 'request_id': 'req-974ae771-abd4-4c9f-b24d-d1928f6c616f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:25.644644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a0e307a7fb428eb8f3746809ee0d99', 'request_id': 'req-974ae771-abd4-4c9f-b24d-d1928f6c616f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:25.650096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a0e307a7fb428eb8f3746809ee0d99', 'request_id': 'req-974ae771-abd4-4c9f-b24d-d1928f6c616f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:25.756076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] The token cache is being invalidate because project 76a0e307a7fb428eb8f3746809ee0d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:25.756750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:25.757137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:25.759033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 924/1882] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:25 2022] DELETE /identity/v3/projects/76a0e307a7fb428eb8f3746809ee0d99 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:25.763091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:25.773825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c8c89-d9ca-4e82-b8af-8bae8a2a42d6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:25.829247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:25.830133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:25.830422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:25.830698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] PATH_INFO: `/v3/users/8e76c3c136614266b63e07e958214fcb` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:25.831918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e76c3c136614266b63e07e958214fcb)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:25.833895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:26.034346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e76c3c136614266b63e07e958214fcb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.041329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e76c3c136614266b63e07e958214fcb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.061487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e76c3c136614266b63e07e958214fcb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.138936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e76c3c136614266b63e07e958214fcb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.143395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-03411a6e-796b-4591-9f4f-89762b1f7b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e76c3c136614266b63e07e958214fcb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.146680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 959/1883] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:25 2022] DELETE /identity/v3/users/8e76c3c136614266b63e07e958214fcb => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:26.546746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:26.550662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:26.561417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ae771-abd4-4c9f-b24d-d1928f6c616f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:26.619781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:26.620709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:26.620996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:26.621400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] PATH_INFO: `/v3/projects/6c2f53a57af845ba9f149626c250dd5e` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:26.622635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2f53a57af845ba9f149626c250dd5e)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:26.626718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:26.743841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2f53a57af845ba9f149626c250dd5e', 'request_id': 'req-4059d229-53e8-49da-a514-03fa47d7ee3e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.749965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2f53a57af845ba9f149626c250dd5e', 'request_id': 'req-4059d229-53e8-49da-a514-03fa47d7ee3e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.755389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2f53a57af845ba9f149626c250dd5e', 'request_id': 'req-4059d229-53e8-49da-a514-03fa47d7ee3e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.843003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] The token cache is being invalidate because project 6c2f53a57af845ba9f149626c250dd5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:26.843652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.843976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4059d229-53e8-49da-a514-03fa47d7ee3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:26.845619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 925/1884] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:26 2022] DELETE /identity/v3/projects/6c2f53a57af845ba9f149626c250dd5e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:26.851371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:26.851773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:26.851917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:26.869141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:26.870274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:26.926521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 960/1885] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:26.935897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:26.936187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:26.941881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:26.956201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:26.957424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:26.965233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 926/1886] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:26.969922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:26.979582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9291814-2719-4be1-9776-8599e60d05fe None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:26.984061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:26.984733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:26.985011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:26.985282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:26.985993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:26.986298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:26.987893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:26.998830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 961/1887] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:27.003109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.012123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c304-33ee-4eda-acd5-f4347c49a949 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.017261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.017897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.018178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.018451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.019160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.021068 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.115411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 927/1888] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:27 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:27.116719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.126987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deec3bb-49c5-463b-835a-1d210d62049e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.182415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.183074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.183377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.183650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.184327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.186263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.279070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 962/1889] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:27 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:27.287416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.290571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abbbde-d915-4e61-b163-133a3fa4a9e2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.295156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.295811 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.296092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.296366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.297122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.298697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.308775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 928/1890] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:27.313058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.322893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d005966-3886-494f-b9d4-70a6f1444a7d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.328179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c91d8-b5a3-4473-ac36-81e74988e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.328871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c91d8-b5a3-4473-ac36-81e74988e95d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.329155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c91d8-b5a3-4473-ac36-81e74988e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.329432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c91d8-b5a3-4473-ac36-81e74988e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.330146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c91d8-b5a3-4473-ac36-81e74988e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.331735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c91d8-b5a3-4473-ac36-81e74988e95d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.341326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 963/1891] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:27.345277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.355326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e2978-b269-4c9e-82d5-da57e32b837c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.360043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.360942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.361219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.361490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] PATH_INFO: `/v3/projects/2aa612a016b94d42b8795923ae02ed74/users/fe5df0301563497b949f547de45cd707/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.375892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa612a016b94d42b8795923ae02ed74, user_id=fe5df0301563497b949f547de45cd707, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.378504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.488024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 929/1892] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:27 2022] PUT /identity/v3/projects/2aa612a016b94d42b8795923ae02ed74/users/fe5df0301563497b949f547de45cd707/roles/246514336b4549609174329cae41663a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:27.499711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.499998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.500273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.526778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] MFA Rules not processed for user `fe5df0301563497b949f547de45cd707`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:27.527984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:27.594020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 964/1893] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:27.598347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.659581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3edb-4b57-4d0c-bb7d-134c38b7be55 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.664204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.664882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.665162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.665436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.666123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.667992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.803172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 930/1894] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:27 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:27.807152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.818169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e14f-9b8e-40db-b229-6e7111454fac None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.871606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.872271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.872586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.872870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.873563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.875657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.962024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 965/1895] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:27 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:27.965960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:27.976740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37785-8d68-4b77-87df-8c43a6c1e57f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:27.981385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:27.982031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:27.982308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:27.982579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:27.983346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:27.985067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:27.995595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 931/1896] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:28.000387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:28.010685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af6083-315e-4fd1-88dd-86bcc03a2f18 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:28.016043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:28.016948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:28.017409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:28.017689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] PATH_INFO: `/v3/projects/4789a861485c415fa774cd7406925e81/users/269318c394f044999c27320c2f1a6276/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:28.033237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4789a861485c415fa774cd7406925e81, user_id=269318c394f044999c27320c2f1a6276, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:28.035958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:28.092493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 966/1897] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:27 2022] PUT /identity/v3/projects/4789a861485c415fa774cd7406925e81/users/269318c394f044999c27320c2f1a6276/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:28.096345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:28.106225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b2fd-b3fe-4eea-98a9-b2ae8e188214 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:28.161433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4faa0d-7c53-4e68-a504-79b30587e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:28.162103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4faa0d-7c53-4e68-a504-79b30587e348 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:28.162388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4faa0d-7c53-4e68-a504-79b30587e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:28.162668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4faa0d-7c53-4e68-a504-79b30587e348 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:28.163389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4faa0d-7c53-4e68-a504-79b30587e348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:28.165016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4faa0d-7c53-4e68-a504-79b30587e348 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:28.174923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 932/1898] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:28.178858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:28.189663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1c46-d003-47e3-822c-2e36140e0609 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:28.194373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:28.195256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:28.195540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:28.195818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] PATH_INFO: `/v3/projects/4789a861485c415fa774cd7406925e81/users/269318c394f044999c27320c2f1a6276/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:28.197831 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4789a861485c415fa774cd7406925e81, user_id=269318c394f044999c27320c2f1a6276, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:28.200529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:28.211905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 967/1899] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:28 2022] PUT /identity/v3/projects/4789a861485c415fa774cd7406925e81/users/269318c394f044999c27320c2f1a6276/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:28.222076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:28.231268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:28.231268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:28.249155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] MFA Rules not processed for user `269318c394f044999c27320c2f1a6276`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:28.250347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:28.315214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 933/1900] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:28.325576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:28.327856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:28.382954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5de9-2d17-477f-acae-637993600fdd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:28.386639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553955e-717b-4c0d-a34a-533e2a0667c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:28.387271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553955e-717b-4c0d-a34a-533e2a0667c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:28.387556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553955e-717b-4c0d-a34a-533e2a0667c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:28.387835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553955e-717b-4c0d-a34a-533e2a0667c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:28.396656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553955e-717b-4c0d-a34a-533e2a0667c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:28.398086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553955e-717b-4c0d-a34a-533e2a0667c0 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:28.407283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 968/1901] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:29.589866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:29.650722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0af67-1c20-4198-9ab2-32149c64652a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:29.656583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:29.657455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:29.657952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:29.658240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] PATH_INFO: `/v3/users/fe5df0301563497b949f547de45cd707` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:29.659448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5df0301563497b949f547de45cd707)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:29.661410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:29.838620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5df0301563497b949f547de45cd707'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:29.839274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5df0301563497b949f547de45cd707'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:29.846081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5df0301563497b949f547de45cd707'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:29.857715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5df0301563497b949f547de45cd707'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:29.858403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5df0301563497b949f547de45cd707'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:29.967694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 934/1902] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:29 2022] DELETE /identity/v3/users/fe5df0301563497b949f547de45cd707 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:29.972560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:29.973046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:29.973191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:29.991673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:29.992880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:30.052384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 969/1903] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:30.062753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:30.064266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:30.118250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d4bea-e2e4-4d1e-b0c9-8107d61309b8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:30.122119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:30.122768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:30.123055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:30.123335 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:30.133207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:30.137347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:30.144349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 935/1904] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:30.655528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:30.657336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:30.670552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46689447-7a5d-419e-bab9-dcdf3a0f057b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:30.682453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:30.683343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:30.686163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:30.686163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] PATH_INFO: `/v3/projects/2aa612a016b94d42b8795923ae02ed74` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:30.686163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa612a016b94d42b8795923ae02ed74)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:30.687968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:30.808187 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa612a016b94d42b8795923ae02ed74', 'request_id': 'req-b659c394-b34c-4d42-a33c-a0aa0380c4bd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:30.847721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:30.847721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:30.857461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9c0e8-4b3a-4861-93fe-e20ded260e1e service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:30.891530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa612a016b94d42b8795923ae02ed74', 'request_id': 'req-b659c394-b34c-4d42-a33c-a0aa0380c4bd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:30.898203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa612a016b94d42b8795923ae02ed74', 'request_id': 'req-b659c394-b34c-4d42-a33c-a0aa0380c4bd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:30.909418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] The token cache is being invalidate because project 2aa612a016b94d42b8795923ae02ed74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:30.909704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:30.910354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:30.912127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 970/1905] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:30 2022] DELETE /identity/v3/projects/2aa612a016b94d42b8795923ae02ed74 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:30.915913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:30.917334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:30.917630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:30.918584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:30.918873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:30.924343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] PATH_INFO: `/v3/users/5302fc5ea1a04d45b613630277c186f7` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:30.924343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5302fc5ea1a04d45b613630277c186f7)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:30.924343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:30.931153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659c394-b34c-4d42-a33c-a0aa0380c4bd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:30.940419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:30.941630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:30.942018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:30.942394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] PATH_INFO: `/v3/users/269318c394f044999c27320c2f1a6276` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:30.943722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269318c394f044999c27320c2f1a6276)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:30.947074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:31.125392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5302fc5ea1a04d45b613630277c186f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.126082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5302fc5ea1a04d45b613630277c186f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.133667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5302fc5ea1a04d45b613630277c186f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.147125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5302fc5ea1a04d45b613630277c186f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.148153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c1baf0c9-c1b1-4b96-8628-e8c14fe0229b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5302fc5ea1a04d45b613630277c186f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.169461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269318c394f044999c27320c2f1a6276'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.177422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269318c394f044999c27320c2f1a6276'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.191602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269318c394f044999c27320c2f1a6276'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.222021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 936/1906] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:30 2022] DELETE /identity/v3/users/5302fc5ea1a04d45b613630277c186f7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:31.228297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:31.228612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:31.228921 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:31.250173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:31.251500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:31.314522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 937/1907] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:31.321676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269318c394f044999c27320c2f1a6276'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.322479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269318c394f044999c27320c2f1a6276'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:31.324679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:31.328447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:31.331477 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 971/1908] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:30 2022] DELETE /identity/v3/users/269318c394f044999c27320c2f1a6276 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:31.395468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc2fad-7253-4c33-b8ee-660b5f17b56c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:31.446145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:31.446888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:31.447233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:31.447571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:31.449656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:31.512302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:31.513898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:31.524119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 938/1909] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:31.954767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:31.956304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:31.984374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:31.986736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:32.002411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78c93-8c52-446e-b4e9-6081c3795534 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.002557 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e60ca-ebc1-46d6-80eb-1344a65d4e24 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.009789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.010716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.011005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.011279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] PATH_INFO: `/v3/projects/b8074d3daf6545879ca691238056e5bb` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.013484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8074d3daf6545879ca691238056e5bb)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.015529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.016540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.016854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.017130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] PATH_INFO: `/v3/projects/4789a861485c415fa774cd7406925e81` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.021094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.021402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4789a861485c415fa774cd7406925e81)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.025725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.153340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8074d3daf6545879ca691238056e5bb', 'request_id': 'req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.161785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8074d3daf6545879ca691238056e5bb', 'request_id': 'req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.167592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8074d3daf6545879ca691238056e5bb', 'request_id': 'req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.198472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4789a861485c415fa774cd7406925e81', 'request_id': 'req-8ed26785-ae12-4167-880b-13a15ba6a985'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.271256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] The token cache is being invalidate because project b8074d3daf6545879ca691238056e5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:32.271543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.272377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c4f9ef2a-1b44-48bf-853a-476a95d92e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.274355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 939/1910] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:31 2022] DELETE /identity/v3/projects/b8074d3daf6545879ca691238056e5bb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:32.279130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63065d-b89b-4fba-b667-6918e0ac6750 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.279426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63065d-b89b-4fba-b667-6918e0ac6750 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.279713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63065d-b89b-4fba-b667-6918e0ac6750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.300330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4a63065d-b89b-4fba-b667-6918e0ac6750 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:32.301577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4a63065d-b89b-4fba-b667-6918e0ac6750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:32.322534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4789a861485c415fa774cd7406925e81', 'request_id': 'req-8ed26785-ae12-4167-880b-13a15ba6a985'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.334033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4789a861485c415fa774cd7406925e81', 'request_id': 'req-8ed26785-ae12-4167-880b-13a15ba6a985'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.352975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] The token cache is being invalidate because project 4789a861485c415fa774cd7406925e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:32.353643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.354543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ed26785-ae12-4167-880b-13a15ba6a985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:32.357328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 972/1911] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:31 2022] DELETE /identity/v3/projects/4789a861485c415fa774cd7406925e81 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:32.362823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c6e25-4b4b-4b34-b9ef-7dfd83a1dadd None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.363729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c6e25-4b4b-4b34-b9ef-7dfd83a1dadd None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.364226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c6e25-4b4b-4b34-b9ef-7dfd83a1dadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.385245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 940/1912] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:32.395397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.395397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.395397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.410561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f14c6e25-4b4b-4b34-b9ef-7dfd83a1dadd None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:32.411790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f14c6e25-4b4b-4b34-b9ef-7dfd83a1dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:32.420601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 973/1913] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:32.423895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:32.425128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:32.433521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 941/1914] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:32.438467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.438467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.438467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.441350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.451029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6f3f-d01d-4211-8d73-78ab8b99ed81 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.459463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.460129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.460412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.460717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.461443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:32.461750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.461993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:32.463343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:32.463645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.475890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 974/1915] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:32.476262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 942/1916] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:32.480886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.481016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.492783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e00a0-0bc2-491e-97c7-c64fb2e13f41 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.493191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a1d9-dae4-4324-a901-228d3aea6f4f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.498047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.498996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.499279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.500100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.501236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:32.501911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.503764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.503764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.503764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.504079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.504808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.506621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.508911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.527394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 975/1917] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:32.528622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.539154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f08b5-7b8c-4631-8e30-843a0eb18868 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.545129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.545804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.546089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.546417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.547429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.549613 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.616558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 943/1918] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:32.618036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.643172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 976/1919] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:32.647293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.690241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d0e9-2b04-437e-b267-711433b2cd82 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.709682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415852-5ae0-4a3b-897a-e6e2991066a0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.714894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.715559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.715844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.716123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.716853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.719302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.756515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.757192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.757473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.758001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.758685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.760753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.846509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 977/1920] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/users => generated 280 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:32.848136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.876254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 944/1921] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:32 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:32.878226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.882448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618131f-107c-43e6-b249-0777e7da0b0b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.894413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.895420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.896041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.896573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.897696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.899796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302bf9d-be77-4859-9ae7-871cf59c22d3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.902922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.907868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.909108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.909587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.910071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.911436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.914616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 978/1922] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:32.919572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.921879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.934001 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622e28-9244-4a01-b6d2-98c522b2e859 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.943079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.943772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.944060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.944339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.946947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.949153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 945/1923] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:32.952679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:32.954390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.973904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b3ee-da5f-4d64-b4f6-807f2b5a4473 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:32.977149 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 979/1924] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:32.978808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:32.982891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:32.984927 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:32.985467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:32.985922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:32.987173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:32.990170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:33.000398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b425d9-f107-482f-991b-bade063e5a7b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:33.008659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c24f-595b-4435-a533-bbde8d093506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:33.010086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c24f-595b-4435-a533-bbde8d093506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.010537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c24f-595b-4435-a533-bbde8d093506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.010996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c24f-595b-4435-a533-bbde8d093506 admin admin] PATH_INFO: `/v3/projects/ac76a3f5db7947b0bda3f6054de52ce4/users/8ce52583dd0d4fc1a301fb5c410e36f1/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.013233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 946/1925] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:33.018304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:33.036184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7103d-d2d5-4dfb-873a-6e2bddfa9f3b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:33.041817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c24f-595b-4435-a533-bbde8d093506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac76a3f5db7947b0bda3f6054de52ce4, user_id=8ce52583dd0d4fc1a301fb5c410e36f1, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:33.045302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0da1f-0e89-4899-b601-275c314b259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:33.047331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0da1f-0e89-4899-b601-275c314b259a admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.047806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0da1f-0e89-4899-b601-275c314b259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.048269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0da1f-0e89-4899-b601-275c314b259a admin admin] PATH_INFO: `/v3/projects/b6d0e45a333e45b6ab3f53e8dddbbb62/users/9eaee09e6e5b44c78804d27a577339cc/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.048823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c24f-595b-4435-a533-bbde8d093506 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:33.074825 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0da1f-0e89-4899-b601-275c314b259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d0e45a333e45b6ab3f53e8dddbbb62, user_id=9eaee09e6e5b44c78804d27a577339cc, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:33.078315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0da1f-0e89-4899-b601-275c314b259a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:33.156996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 980/1926] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:32 2022] PUT /identity/v3/projects/ac76a3f5db7947b0bda3f6054de52ce4/users/8ce52583dd0d4fc1a301fb5c410e36f1/roles/246514336b4549609174329cae41663a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:33.166607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.166896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.167177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.182212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 947/1927] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:33 2022] PUT /identity/v3/projects/b6d0e45a333e45b6ab3f53e8dddbbb62/users/9eaee09e6e5b44c78804d27a577339cc/roles/246514336b4549609174329cae41663a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:33.193217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.193628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.193982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.206309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] MFA Rules not processed for user `8ce52583dd0d4fc1a301fb5c410e36f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:33.207526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:33.229307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] MFA Rules not processed for user `9eaee09e6e5b44c78804d27a577339cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:33.229307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:33.284008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 981/1928] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:33.307468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 948/1929] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:33.308514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:33.309902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:33.318521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:33.319839 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:33.374163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642629-4860-43f0-aeea-f16ec6f8e415 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:33.377896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:33.378614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.378965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.379308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.386182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47137c8-c2fd-48a4-b21a-efeaf5cb3e92 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:33.388864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:33.390395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec60ff-4dee-41e9-9fd0-7b4bfa07a8b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:33.391033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec60ff-4dee-41e9-9fd0-7b4bfa07a8b2 service glance] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.391331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec60ff-4dee-41e9-9fd0-7b4bfa07a8b2 service glance] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.391601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec60ff-4dee-41e9-9fd0-7b4bfa07a8b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.392776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:33.400806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec60ff-4dee-41e9-9fd0-7b4bfa07a8b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:33.402472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 982/1930] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:33.402839 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec60ff-4dee-41e9-9fd0-7b4bfa07a8b2 service glance] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:33.413342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 949/1931] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:33.420060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:33.498669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1cfb2-d922-4679-bb3d-f441780861ec service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:33.506705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:33.507947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.508211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.508520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] PATH_INFO: `/v3/users/8ce52583dd0d4fc1a301fb5c410e36f1` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.509747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce52583dd0d4fc1a301fb5c410e36f1)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:33.511693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:33.731455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce52583dd0d4fc1a301fb5c410e36f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:33.739633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce52583dd0d4fc1a301fb5c410e36f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:33.753311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce52583dd0d4fc1a301fb5c410e36f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:33.818659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce52583dd0d4fc1a301fb5c410e36f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:33.819373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce52583dd0d4fc1a301fb5c410e36f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:33.825745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 983/1932] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:33 2022] DELETE /identity/v3/users/8ce52583dd0d4fc1a301fb5c410e36f1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:33.830207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.830486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.830760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.847114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:33.850160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:33.905432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 950/1933] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:33.914916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:33.916302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:33.977724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308dc87-b58b-4299-a001-5a3425e33535 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:33.981410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455375b-549f-4d9a-82ad-f5c888b6ff55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:33.982056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455375b-549f-4d9a-82ad-f5c888b6ff55 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:33.982364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455375b-549f-4d9a-82ad-f5c888b6ff55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:33.982694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455375b-549f-4d9a-82ad-f5c888b6ff55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:33.992540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455375b-549f-4d9a-82ad-f5c888b6ff55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:33.993911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455375b-549f-4d9a-82ad-f5c888b6ff55 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:34.003320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 984/1934] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:34.095016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:34.096400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:34.108056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80978a97-83ec-41ef-a435-5ca3766f59c2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:34.113157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:34.114009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:34.114289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:34.114573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] PATH_INFO: `/v3/users/738dd8536500418bb42e47aa37c3b507` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:34.115735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=738dd8536500418bb42e47aa37c3b507)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:34.117664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:34.270687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738dd8536500418bb42e47aa37c3b507'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.271415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738dd8536500418bb42e47aa37c3b507'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.283451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738dd8536500418bb42e47aa37c3b507'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.299140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738dd8536500418bb42e47aa37c3b507'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.299883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738dd8536500418bb42e47aa37c3b507'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.442291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 951/1935] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:34 2022] DELETE /identity/v3/users/738dd8536500418bb42e47aa37c3b507 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:34.446753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:34.447246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:34.447339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:34.464063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:34.465276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:34.524070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 985/1936] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:34.533851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:34.535256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:34.556082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:34.557531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:34.570377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2a47-9e57-4667-b9ef-703d54ac27f0 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:34.576563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:34.577702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:34.577702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:34.578042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] PATH_INFO: `/v3/projects/ac76a3f5db7947b0bda3f6054de52ce4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:34.579302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac76a3f5db7947b0bda3f6054de52ce4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:34.581937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:34.610922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264fa9-dcfd-46cf-93b7-e4db7f3be62d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:34.615376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:34.616044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:34.617168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:34.617168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:34.627518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:34.629185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:34.639440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 952/1937] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:34.683165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac76a3f5db7947b0bda3f6054de52ce4', 'request_id': 'req-dd842e50-f09d-49a3-9af7-7e4a5e578917'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.785697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac76a3f5db7947b0bda3f6054de52ce4', 'request_id': 'req-dd842e50-f09d-49a3-9af7-7e4a5e578917'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.795090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac76a3f5db7947b0bda3f6054de52ce4', 'request_id': 'req-dd842e50-f09d-49a3-9af7-7e4a5e578917'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.809241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] The token cache is being invalidate because project ac76a3f5db7947b0bda3f6054de52ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:34.809618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.810608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:34.824469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 986/1938] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:34 2022] DELETE /identity/v3/projects/ac76a3f5db7947b0bda3f6054de52ce4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:35.112320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:35.113835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:35.126678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22eed7-caa4-49a1-be38-27a83128accc service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:35.188713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:35.189572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:35.189848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:35.190144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] PATH_INFO: `/v3/projects/0a255d9d7e2d4887928944757d8dd246` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:35.191303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a255d9d7e2d4887928944757d8dd246)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:35.193276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:35.293075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a255d9d7e2d4887928944757d8dd246', 'request_id': 'req-c141e7c5-e86d-4b8c-979c-031a44a75e83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.299402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a255d9d7e2d4887928944757d8dd246', 'request_id': 'req-c141e7c5-e86d-4b8c-979c-031a44a75e83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.305065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a255d9d7e2d4887928944757d8dd246', 'request_id': 'req-c141e7c5-e86d-4b8c-979c-031a44a75e83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.399738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] The token cache is being invalidate because project 0a255d9d7e2d4887928944757d8dd246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:35.400027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.400784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.402353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 953/1939] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:35 2022] DELETE /identity/v3/projects/0a255d9d7e2d4887928944757d8dd246 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:35.407088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:35.408588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:35.421680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842e50-f09d-49a3-9af7-7e4a5e578917 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:35.479678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:35.480691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:35.480971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:35.481246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] PATH_INFO: `/v3/users/605d8f699fba424baf0552f6842e21c2` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:35.482470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605d8f699fba424baf0552f6842e21c2)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:35.484482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:35.658940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605d8f699fba424baf0552f6842e21c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.665793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605d8f699fba424baf0552f6842e21c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.677378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605d8f699fba424baf0552f6842e21c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.755089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605d8f699fba424baf0552f6842e21c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.755700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dc23a203-2240-47ab-82e5-ddead479cc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605d8f699fba424baf0552f6842e21c2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:35.762568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 987/1940] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:35 2022] DELETE /identity/v3/users/605d8f699fba424baf0552f6842e21c2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:36.212265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:36.215673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:36.228106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141e7c5-e86d-4b8c-979c-031a44a75e83 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:36.298188 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:36.299085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.299368 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.299643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] PATH_INFO: `/v3/projects/083721edf1e244678144ec4277581951` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.300891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083721edf1e244678144ec4277581951)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:36.302836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:36.411031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083721edf1e244678144ec4277581951', 'request_id': 'req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:36.417359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083721edf1e244678144ec4277581951', 'request_id': 'req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:36.423345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083721edf1e244678144ec4277581951', 'request_id': 'req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:36.491527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] The token cache is being invalidate because project 083721edf1e244678144ec4277581951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:36.491733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:36.492328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f7433379-1a1f-4a36-8481-1bc0ca7e6a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:36.493906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 954/1941] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:36 2022] DELETE /identity/v3/projects/083721edf1e244678144ec4277581951 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:36.498800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85395691-b8cd-4279-9570-79ce672af875 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.499730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85395691-b8cd-4279-9570-79ce672af875 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.499730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85395691-b8cd-4279-9570-79ce672af875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.517199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-85395691-b8cd-4279-9570-79ce672af875 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:36.518431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-85395691-b8cd-4279-9570-79ce672af875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:36.582373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 988/1942] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:36.590847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.591132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.591407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.611664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:36.612888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:36.621417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 955/1943] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:36.625812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85395691-b8cd-4279-9570-79ce672af875 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:36.635867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85395691-b8cd-4279-9570-79ce672af875 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:36.641855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:36.652147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.652147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.652147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.652147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:36.652147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:36.652147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:36.658538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 989/1944] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:36.663009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:36.675426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598b12a-6a85-4bbd-935f-9b8940eac03a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:36.684623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:36.685332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.686756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.686756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.686913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:36.688895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:36.802248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 956/1945] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:36 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:36.806429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:36.816896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b595c6-0c56-40e9-88df-c75821053d98 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:36.872958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:36.873623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.873909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.874801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.875509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:36.877445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:36.948585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 990/1946] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:36 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:36.952837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:36.963011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4b961-8cd4-44eb-901e-f203222e3b93 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:36.967563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:36.968752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:36.969029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:36.969301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:36.970058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:36.971624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:36.981704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 957/1947] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:36.986212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:36.996226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47901a-3dab-45d4-b01a-279826657152 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.001897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125ee8-711d-4a5d-8c6e-354eefbaf1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.002591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ee8-711d-4a5d-8c6e-354eefbaf1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.002875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ee8-711d-4a5d-8c6e-354eefbaf1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.003157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ee8-711d-4a5d-8c6e-354eefbaf1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.003889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125ee8-711d-4a5d-8c6e-354eefbaf1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.005540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125ee8-711d-4a5d-8c6e-354eefbaf1fc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.015906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 991/1948] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:37.019960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.029700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3439d9-c51d-4ff9-b1fe-e907bbaf19f0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.034824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.035687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.035964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.036236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] PATH_INFO: `/v3/projects/805b2e9e0c7a464ebca3bb1fffdcee20/users/918cc43705df4d20ab0a34aa4d459f4b/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.052350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805b2e9e0c7a464ebca3bb1fffdcee20, user_id=918cc43705df4d20ab0a34aa4d459f4b, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.054915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.120024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 958/1949] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:37 2022] PUT /identity/v3/projects/805b2e9e0c7a464ebca3bb1fffdcee20/users/918cc43705df4d20ab0a34aa4d459f4b/roles/246514336b4549609174329cae41663a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:37.130358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.130648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.130926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.157484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] MFA Rules not processed for user `918cc43705df4d20ab0a34aa4d459f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:37.158688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:37.227516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 992/1950] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:37.232073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.299735 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbca7d1-88f3-426d-9930-c85e697dacd7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.304951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.305538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.305820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.306093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.306786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.308802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.420398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 959/1951] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:37 2022] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:37.422344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.437197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08447df4-8f9c-4f36-927b-f3979458a1d5 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.520013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.520830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.521189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.521471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.522167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.524155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.607735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 993/1952] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:37 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:37.611556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.621898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5738e-931c-4182-b222-2409184e9807 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.626640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.627306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.631484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.631484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.631484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.631484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.641313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 960/1953] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:37.645441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.655384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70986f-97ca-4f0f-9c5f-db797f208022 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.660823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.661781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.662061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.662338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] PATH_INFO: `/v3/projects/673a47929b6343538f6c33ae8c63fafa/users/dde3a74e6c85479f87b352123385ccf4/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.683186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673a47929b6343538f6c33ae8c63fafa, user_id=dde3a74e6c85479f87b352123385ccf4, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.686032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.784789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 994/1954] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:37 2022] PUT /identity/v3/projects/673a47929b6343538f6c33ae8c63fafa/users/dde3a74e6c85479f87b352123385ccf4/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:37.788908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.798708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac3ad3-27a2-46b4-ba35-ddb0374466de admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.862697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948efa2f-d74a-41bf-a4bd-7f52b0f96f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.863411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948efa2f-d74a-41bf-a4bd-7f52b0f96f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.863712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948efa2f-d74a-41bf-a4bd-7f52b0f96f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.863993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948efa2f-d74a-41bf-a4bd-7f52b0f96f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.864780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948efa2f-d74a-41bf-a4bd-7f52b0f96f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.866406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948efa2f-d74a-41bf-a4bd-7f52b0f96f69 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.880973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 961/1955] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:37.882316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:37.894912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309da2e-d912-4bf4-93c6-19f964c0b934 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:37.902515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:37.903410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.903725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.904006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] PATH_INFO: `/v3/projects/673a47929b6343538f6c33ae8c63fafa/users/dde3a74e6c85479f87b352123385ccf4/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.906076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673a47929b6343538f6c33ae8c63fafa, user_id=dde3a74e6c85479f87b352123385ccf4, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:37.908844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:37.919347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 995/1956] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:37 2022] PUT /identity/v3/projects/673a47929b6343538f6c33ae8c63fafa/users/dde3a74e6c85479f87b352123385ccf4/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:37.930606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:37.931286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:37.931710 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:37.959877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] MFA Rules not processed for user `dde3a74e6c85479f87b352123385ccf4`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:37.961137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:38.050287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 962/1957] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:38.060924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:38.063401 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:38.125812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ff103-7648-43fa-822d-cf80b20fa249 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:38.129644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9173-25a7-4b8f-ba56-a8941f4cf684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:38.130343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9173-25a7-4b8f-ba56-a8941f4cf684 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:38.130627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9173-25a7-4b8f-ba56-a8941f4cf684 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:38.130913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9173-25a7-4b8f-ba56-a8941f4cf684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:38.140801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9173-25a7-4b8f-ba56-a8941f4cf684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:38.142248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9173-25a7-4b8f-ba56-a8941f4cf684 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:38.151767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 996/1958] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:38.564601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:38.633690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c02f57-e161-4bfe-bfc7-0da6597a27ab None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:38.638291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:38.639191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:38.642106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:38.642106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] PATH_INFO: `/v3/users/918cc43705df4d20ab0a34aa4d459f4b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:38.642106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=918cc43705df4d20ab0a34aa4d459f4b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:38.642922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:38.822677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918cc43705df4d20ab0a34aa4d459f4b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:38.823725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918cc43705df4d20ab0a34aa4d459f4b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:38.832766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918cc43705df4d20ab0a34aa4d459f4b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:38.845711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918cc43705df4d20ab0a34aa4d459f4b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:38.846545 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918cc43705df4d20ab0a34aa4d459f4b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:38.910239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 963/1959] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:38 2022] DELETE /identity/v3/users/918cc43705df4d20ab0a34aa4d459f4b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:38.914978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:38.915488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:38.915657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:38.934039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:38.935094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:38.992031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 997/1960] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:39.002002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:39.006247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:39.073316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5c2c0-f89e-408e-891f-6757d18f13cf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:39.085248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:39.085968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:39.086250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:39.086524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:39.097333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:39.098888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:39.109287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 964/1961] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:39.557611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:39.559251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:39.572647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e7a8-5335-4531-b4ba-41074b8c1545 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:39.598791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:39.599825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:39.600193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:39.600550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] PATH_INFO: `/v3/projects/805b2e9e0c7a464ebca3bb1fffdcee20` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:39.601808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805b2e9e0c7a464ebca3bb1fffdcee20)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:39.604731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:39.771919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805b2e9e0c7a464ebca3bb1fffdcee20', 'request_id': 'req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:39.842011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805b2e9e0c7a464ebca3bb1fffdcee20', 'request_id': 'req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:39.849259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805b2e9e0c7a464ebca3bb1fffdcee20', 'request_id': 'req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:39.861965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] The token cache is being invalidate because project 805b2e9e0c7a464ebca3bb1fffdcee20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:39.862427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:39.863760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:39.865511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 998/1962] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:39 2022] DELETE /identity/v3/projects/805b2e9e0c7a464ebca3bb1fffdcee20 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:39.869651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:39.880106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba5a0-8896-4314-94d5-0af435287709 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:39.937659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:39.938529 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:39.938843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:39.939163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] PATH_INFO: `/v3/users/dde3a74e6c85479f87b352123385ccf4` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:39.940354 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde3a74e6c85479f87b352123385ccf4)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:39.942325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:40.129721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde3a74e6c85479f87b352123385ccf4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.130366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde3a74e6c85479f87b352123385ccf4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.137256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde3a74e6c85479f87b352123385ccf4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.148520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde3a74e6c85479f87b352123385ccf4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.149191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-af0ed57c-714a-420e-8b8a-d6bb1c10be33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde3a74e6c85479f87b352123385ccf4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.225842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 965/1963] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:39 2022] DELETE /identity/v3/users/dde3a74e6c85479f87b352123385ccf4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:40.677606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:40.679037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:40.694541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7fd6-1926-45dd-a9e3-b9cb2f13fbb3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:40.757140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:40.758724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:40.759196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:40.759494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] PATH_INFO: `/v3/projects/673a47929b6343538f6c33ae8c63fafa` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:40.761424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=673a47929b6343538f6c33ae8c63fafa)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:40.763424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:40.895307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673a47929b6343538f6c33ae8c63fafa', 'request_id': 'req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.972055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673a47929b6343538f6c33ae8c63fafa', 'request_id': 'req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.978707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673a47929b6343538f6c33ae8c63fafa', 'request_id': 'req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.989417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] The token cache is being invalidate because project 673a47929b6343538f6c33ae8c63fafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:40.989885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.990522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ca783d5e-f502-4ddd-bb10-d2d1ca331e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:40.992325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 999/1964] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:40 2022] DELETE /identity/v3/projects/673a47929b6343538f6c33ae8c63fafa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:40.997418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:40.997891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:40.997986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.016616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:41.018259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:41.078041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 966/1965] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:41.085795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.086079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.086357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.104966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:41.106855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:41.119533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1000/1966] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:41.132938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.142357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fcff-f4f0-4354-87f2-01a24fb7f723 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.147642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.148309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.148663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.148897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.149634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:41.150001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.160154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.172162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 967/1967] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:41.178320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.187899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64579-7845-4dfc-828d-7ed74ed59c3e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.194162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.195185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.195476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.195752 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.196969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.199633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.308212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1001/1968] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:41 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:41.309349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.319551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba112-324a-454d-861b-7e4eca59cbe0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.378166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.378837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.379120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.379556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.380253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.382265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.494449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 968/1969] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:41 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:41.499264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.511967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489edda-fd39-45e4-8608-53c4242d24d5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.516723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.517555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.517837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.518110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.518833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.520480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.535634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1002/1970] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:41.539782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.550753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aeb9f-ae01-4baa-882f-92b59652bde8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.555447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7036-7480-475d-9573-3e146cca75c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.556366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7036-7480-475d-9573-3e146cca75c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.557004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7036-7480-475d-9573-3e146cca75c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.557648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7036-7480-475d-9573-3e146cca75c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.558608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c7036-7480-475d-9573-3e146cca75c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.560824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c7036-7480-475d-9573-3e146cca75c8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.575257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 969/1971] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:41.579774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.590935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d87a-0de7-4270-b644-08cfa1225546 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.596568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.597461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.597745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.598023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] PATH_INFO: `/v3/projects/316204d3b45349488771ef87fe915008/users/9cf4a039e91547b69c5f15908dcc73cc/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.618642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316204d3b45349488771ef87fe915008, user_id=9cf4a039e91547b69c5f15908dcc73cc, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.621660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.672053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1003/1972] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:41 2022] PUT /identity/v3/projects/316204d3b45349488771ef87fe915008/users/9cf4a039e91547b69c5f15908dcc73cc/roles/246514336b4549609174329cae41663a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:41.686705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.686998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.687276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.717769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] MFA Rules not processed for user `9cf4a039e91547b69c5f15908dcc73cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:41.719004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:41.788732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 970/1973] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:41.793152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.854592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2417c-6428-498c-83df-0a8bdbc329f2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:41.859341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:41.859999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:41.860291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:41.860641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:41.861347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:41.863274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:41.962649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1004/1974] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:41 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:41.966627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:41.977878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803ca0-34e0-4eeb-88ff-3be2002d7a01 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.034433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.035083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.035371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.035644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.036335 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.038278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.124854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 971/1975] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:41 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:42.126633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:42.137269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d521b-8bcc-4bbe-a2be-ce847ceacce1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.142916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.143622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.143906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.144183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.144988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.146588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.158345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1005/1976] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:42.162492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:42.172702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5915f4-4d38-4af0-a87d-d405cfe195aa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.177666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.178550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.178840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.179115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] PATH_INFO: `/v3/projects/ab6d7feb66eb4b9cab3509db9e3a0077/users/65ae4fad8c1c48369c8d21291d7b3dc8/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.195943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6d7feb66eb4b9cab3509db9e3a0077, user_id=65ae4fad8c1c48369c8d21291d7b3dc8, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.198787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.254212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 972/1977] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:42 2022] PUT /identity/v3/projects/ab6d7feb66eb4b9cab3509db9e3a0077/users/65ae4fad8c1c48369c8d21291d7b3dc8/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:42.258278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:42.275573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77589e26-9a69-4ebc-806e-05a3916ec3b9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.342544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c199db2-8028-4e50-8625-8f0366511a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.343210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c199db2-8028-4e50-8625-8f0366511a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.343491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c199db2-8028-4e50-8625-8f0366511a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.343767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c199db2-8028-4e50-8625-8f0366511a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.344574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c199db2-8028-4e50-8625-8f0366511a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.346211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c199db2-8028-4e50-8625-8f0366511a56 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.356065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1006/1978] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:42.365124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:42.375769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e2c9-5ca9-48bf-b9c0-77b397e3e130 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.381115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.382055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.382402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.383021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] PATH_INFO: `/v3/projects/ab6d7feb66eb4b9cab3509db9e3a0077/users/65ae4fad8c1c48369c8d21291d7b3dc8/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.385080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6d7feb66eb4b9cab3509db9e3a0077, user_id=65ae4fad8c1c48369c8d21291d7b3dc8, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.387776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.399746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 973/1979] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:42 2022] PUT /identity/v3/projects/ab6d7feb66eb4b9cab3509db9e3a0077/users/65ae4fad8c1c48369c8d21291d7b3dc8/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:42.410753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.411036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.413258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.436617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] MFA Rules not processed for user `65ae4fad8c1c48369c8d21291d7b3dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:42.437784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:42.509954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1007/1980] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:42.521197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:42.523187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:42.586841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630309e-617b-4c1c-891d-66db55b0d76c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.590661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.591308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.591626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.591929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.601002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.602434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.617236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 974/1981] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:42.660582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:42.660582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:42.676736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893074d-329f-4193-989c-c92dbd56f9d4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:42.680943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:42.681594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:42.681874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:42.682148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:42.744062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:42.745663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:42.756867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1008/1982] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:43.077948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:43.079396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:43.150468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3f22-6829-4af6-8fbd-9dfafa018ab7 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:43.155052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:43.155912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:43.156191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:43.156628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] PATH_INFO: `/v3/users/210676a641554f6e816dda2a7717cbc4` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:43.158474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=210676a641554f6e816dda2a7717cbc4)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:43.160398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:43.349827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210676a641554f6e816dda2a7717cbc4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:43.350526 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210676a641554f6e816dda2a7717cbc4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:43.359370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210676a641554f6e816dda2a7717cbc4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:43.379387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210676a641554f6e816dda2a7717cbc4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:43.380126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-483cff63-f209-432a-b3f1-7715f32e41a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210676a641554f6e816dda2a7717cbc4'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:43.456689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 975/1983] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:43 2022] DELETE /identity/v3/users/210676a641554f6e816dda2a7717cbc4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:43.710763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:43.721484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ed5e-ac22-45c7-8176-1761e06efabb service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:43.780768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:43.781636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:43.781920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:43.782197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] PATH_INFO: `/v3/projects/a2fb11bd56f946d1a12bb7aba48aece1` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:43.783394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fb11bd56f946d1a12bb7aba48aece1)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:43.785367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:43.923520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fb11bd56f946d1a12bb7aba48aece1', 'request_id': 'req-bf600442-5600-4a06-9382-04083f899903'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:43.989909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fb11bd56f946d1a12bb7aba48aece1', 'request_id': 'req-bf600442-5600-4a06-9382-04083f899903'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:44.000617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fb11bd56f946d1a12bb7aba48aece1', 'request_id': 'req-bf600442-5600-4a06-9382-04083f899903'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:44.008569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] The token cache is being invalidate because project a2fb11bd56f946d1a12bb7aba48aece1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:44.008871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:44.009535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-bf600442-5600-4a06-9382-04083f899903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:44.011093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1009/1984] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:43 2022] DELETE /identity/v3/projects/a2fb11bd56f946d1a12bb7aba48aece1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:44.016389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.016715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.017048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.034812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:44.035999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:44.097509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 976/1985] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:44.105715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.106087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.106525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.125452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:44.126738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:44.135675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1010/1986] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:44.140118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.150068 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23efbad-b257-413e-9d1d-7fa5d31abbdc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.154676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.155328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.155613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.155892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.156663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:44.156971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.158640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.173380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 977/1987] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:44.175092 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.184248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c2ffe-c420-4644-a1d1-aa04a2a54789 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.189061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.190265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.190549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.190824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.191552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.193504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.271660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1011/1988] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:44.275848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.285883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e62a3-b882-4ac2-a786-9255d72eb2f2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.342677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.343261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.343540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.343816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.344541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.346489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.416371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 978/1989] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:44.417819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.429204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b190e-5cca-4f98-bef0-af3aa3e41740 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.433923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.434689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.435039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.435475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.436322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.438616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.450930 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1012/1990] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:44.454983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.467382 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c825c-a9de-4485-afd6-8406f2c61d21 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.472987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d42234-54fe-4bbb-a4eb-02a7337dc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.473646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42234-54fe-4bbb-a4eb-02a7337dc0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.473928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42234-54fe-4bbb-a4eb-02a7337dc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.474204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42234-54fe-4bbb-a4eb-02a7337dc0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.474988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42234-54fe-4bbb-a4eb-02a7337dc0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.476644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42234-54fe-4bbb-a4eb-02a7337dc0f8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.487404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 979/1991] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:44.491635 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.505200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0f76-9b22-4f25-9fa1-0d3878527aec admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.510295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.512491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.512491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.512491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] PATH_INFO: `/v3/projects/14eea26ca14f4ca68a18f4e0137acb15/users/9b981d4776904dba9eea8f54b8099552/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.529789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eea26ca14f4ca68a18f4e0137acb15, user_id=9b981d4776904dba9eea8f54b8099552, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.535086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.660774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1013/1992] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:44 2022] PUT /identity/v3/projects/14eea26ca14f4ca68a18f4e0137acb15/users/9b981d4776904dba9eea8f54b8099552/roles/246514336b4549609174329cae41663a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:44.671034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.671520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.671804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.712855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] MFA Rules not processed for user `9b981d4776904dba9eea8f54b8099552`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:44.714160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:44.777983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 980/1993] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:44.782919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.850621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775871f-0c62-4c29-a245-6cf8f7e98981 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:44.855680 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:44.856356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:44.856877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:44.857185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:44.857874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:44.859862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:44.981342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1014/1994] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:44.985359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:44.995816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb96eb-133d-4bf6-afdb-03e2c029026c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:45.049602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:45.050362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.050679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.050959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.051731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:45.053807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:45.145913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 981/1995] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:44 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:45.149638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:45.159674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790afe-61a1-4d52-8204-486210fb1d65 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:45.164247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:45.164939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.165218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.165490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.166201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:45.167790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:45.178323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1015/1996] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:45.182423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:45.193837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2995c1-c6f1-42ee-b681-289e6851a43d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:45.199161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:45.200127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.200411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.200722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] PATH_INFO: `/v3/projects/2c7a508dc31942ecae8e2f9f583e1a11/users/346e4db7af414c9381994cd5b7b3d962/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.216411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7a508dc31942ecae8e2f9f583e1a11, user_id=346e4db7af414c9381994cd5b7b3d962, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:45.219108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:45.316445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 982/1997] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:45 2022] PUT /identity/v3/projects/2c7a508dc31942ecae8e2f9f583e1a11/users/346e4db7af414c9381994cd5b7b3d962/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:45.320338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:45.331070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a069-346a-4339-906f-4fc923e94627 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:45.388054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c8741-eaad-4bed-ac52-e784d6b97759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:45.388765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c8741-eaad-4bed-ac52-e784d6b97759 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.389051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c8741-eaad-4bed-ac52-e784d6b97759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.389328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c8741-eaad-4bed-ac52-e784d6b97759 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.390077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c8741-eaad-4bed-ac52-e784d6b97759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:45.391690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c8741-eaad-4bed-ac52-e784d6b97759 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:45.407652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1016/1998] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:45.407822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:45.416441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5365b3-5fb7-4b2c-be86-d3bc8240946c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:45.421196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:45.422075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.422365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.423003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] PATH_INFO: `/v3/projects/2c7a508dc31942ecae8e2f9f583e1a11/users/346e4db7af414c9381994cd5b7b3d962/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.424854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7a508dc31942ecae8e2f9f583e1a11, user_id=346e4db7af414c9381994cd5b7b3d962, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:45.427979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:45.445181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 983/1999] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:45 2022] PUT /identity/v3/projects/2c7a508dc31942ecae8e2f9f583e1a11/users/346e4db7af414c9381994cd5b7b3d962/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:45.457036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.457325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.465274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.484649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] MFA Rules not processed for user `346e4db7af414c9381994cd5b7b3d962`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:45.485848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:45.553251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1017/2000] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:45.682342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:45.686699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:45.802864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb93e-04bb-478f-a1c0-17da02b47557 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:45.807050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd2dc2-7066-4749-98f9-508465624d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:45.807734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2dc2-7066-4749-98f9-508465624d41 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:45.808022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2dc2-7066-4749-98f9-508465624d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:45.808297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2dc2-7066-4749-98f9-508465624d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:45.818432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd2dc2-7066-4749-98f9-508465624d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:45.819937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd2dc2-7066-4749-98f9-508465624d41 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:45.831692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 984/2001] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:46.052703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:46.062255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715b37b-c9d0-40c2-8368-d6d90efa1315 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:46.065841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:46.066483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:46.066765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:46.067041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:46.124803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:46.126247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:46.135539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1018/2002] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:46.737859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f50d-4010-479b-b7ac-71cbc903ff82 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:46.738357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f50d-4010-479b-b7ac-71cbc903ff82 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:46.738357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f50d-4010-479b-b7ac-71cbc903ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:46.756456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-fcd8f50d-4010-479b-b7ac-71cbc903ff82 None None] MFA Rules not processed for user `35d4828335a543758d1413c0276657a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:46.757656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-fcd8f50d-4010-479b-b7ac-71cbc903ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:46.820994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 985/2003] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:48.546244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:48.547761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:48.614461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723936-7666-4ee7-bf6e-fe9e8d91efdf service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:48.619668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:48.620948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:48.620948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:48.620948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] PATH_INFO: `/v3/users/9cf4a039e91547b69c5f15908dcc73cc` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:48.623304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf4a039e91547b69c5f15908dcc73cc)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:48.625285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:48.823706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf4a039e91547b69c5f15908dcc73cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:48.831227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf4a039e91547b69c5f15908dcc73cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:48.842807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf4a039e91547b69c5f15908dcc73cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:48.909083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf4a039e91547b69c5f15908dcc73cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:48.910404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf4a039e91547b69c5f15908dcc73cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:48.917323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1019/2004] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:48 2022] DELETE /identity/v3/users/9cf4a039e91547b69c5f15908dcc73cc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:48.921916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:48.922389 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:48.922480 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:48.943902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:48.945907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:49.006073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 986/2005] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:49.018620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:49.020257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:49.091027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae867aa-a0ff-41e0-b648-0413fdb31514 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:49.094715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:49.095468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:49.095752 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:49.096026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:49.135775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:49.135775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:49.135775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1020/2006] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:49.684646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:49.686398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:49.704315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f8411-d476-44ef-a899-335d0e0ea0e0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:49.719323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:49.719323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:49.719323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:49.719323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] PATH_INFO: `/v3/projects/316204d3b45349488771ef87fe915008` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:49.719648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=316204d3b45349488771ef87fe915008)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:49.719648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:49.793627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:49.800094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:49.812740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3c6f-be56-42a8-ba29-5714bac7aafb service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:49.818544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:49.819432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:49.819725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:49.820002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] PATH_INFO: `/v3/users/9b981d4776904dba9eea8f54b8099552` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:49.821288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b981d4776904dba9eea8f54b8099552)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:49.823322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:49.845937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316204d3b45349488771ef87fe915008', 'request_id': 'req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:49.852776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316204d3b45349488771ef87fe915008', 'request_id': 'req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:49.858342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316204d3b45349488771ef87fe915008', 'request_id': 'req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:49.938585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] The token cache is being invalidate because project 316204d3b45349488771ef87fe915008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:49.939846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:49.940814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:49.945782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 987/2007] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:49 2022] DELETE /identity/v3/projects/316204d3b45349488771ef87fe915008 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:49.946899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:49.948346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:50.015684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b981d4776904dba9eea8f54b8099552'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.018658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a333f4-c4c7-429d-a1d5-bb7a00e03d0e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:50.024343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b981d4776904dba9eea8f54b8099552'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.026914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:50.027796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:50.028214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:50.028709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] PATH_INFO: `/v3/users/65ae4fad8c1c48369c8d21291d7b3dc8` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:50.036600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ae4fad8c1c48369c8d21291d7b3dc8)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:50.036600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:50.048373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b981d4776904dba9eea8f54b8099552'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.155603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b981d4776904dba9eea8f54b8099552'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.156358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-2ea4f322-22d9-40b9-968f-57cbf56700d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b981d4776904dba9eea8f54b8099552'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.163721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1021/2008] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:49 2022] DELETE /identity/v3/users/9b981d4776904dba9eea8f54b8099552 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:50.168063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:50.168357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:50.168692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:50.185651 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:50.186855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:50.251811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1022/2009] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:50.266348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:50.268066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ae4fad8c1c48369c8d21291d7b3dc8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.268581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:50.268756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ae4fad8c1c48369c8d21291d7b3dc8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.276086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ae4fad8c1c48369c8d21291d7b3dc8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.288420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ae4fad8c1c48369c8d21291d7b3dc8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.289151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ae4fad8c1c48369c8d21291d7b3dc8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:50.330799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99d14-3069-4a43-9348-df713d2f93fb None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:50.334835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:50.335540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:50.335825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:50.336102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:50.337988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:50.349287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 988/2010] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:49 2022] DELETE /identity/v3/users/65ae4fad8c1c48369c8d21291d7b3dc8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:50.352475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:50.352475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:50.364212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1023/2011] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:51.244052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:51.247326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:51.255487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:51.257458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:51.270276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619767d7-4385-4674-9ae2-a0f774615342 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:51.339456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102e607-753a-417f-823d-64e12517e98b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:51.344520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:51.344520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.344520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.344825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] PATH_INFO: `/v3/projects/14eea26ca14f4ca68a18f4e0137acb15` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.344908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:51.346441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eea26ca14f4ca68a18f4e0137acb15)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:51.346694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.347043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.347393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] PATH_INFO: `/v3/projects/ab6d7feb66eb4b9cab3509db9e3a0077` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.348679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6d7feb66eb4b9cab3509db9e3a0077)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:51.348826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:51.350902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:51.451112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6d7feb66eb4b9cab3509db9e3a0077', 'request_id': 'req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.457268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6d7feb66eb4b9cab3509db9e3a0077', 'request_id': 'req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.462835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6d7feb66eb4b9cab3509db9e3a0077', 'request_id': 'req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.476257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eea26ca14f4ca68a18f4e0137acb15', 'request_id': 'req-3aff569f-e08c-4b0d-9eab-7493131c7258'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.530988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] The token cache is being invalidate because project ab6d7feb66eb4b9cab3509db9e3a0077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:51.531275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.531883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-171f1e5f-53b7-4076-95a2-1c86f0b0e7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.534088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 989/2012] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:51 2022] DELETE /identity/v3/projects/ab6d7feb66eb4b9cab3509db9e3a0077 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:51.539317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fecca3-3e1c-44bb-b244-8c43f52eef74 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.539603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fecca3-3e1c-44bb-b244-8c43f52eef74 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.539878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fecca3-3e1c-44bb-b244-8c43f52eef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.557163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-22fecca3-3e1c-44bb-b244-8c43f52eef74 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:51.563630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-22fecca3-3e1c-44bb-b244-8c43f52eef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:51.583713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eea26ca14f4ca68a18f4e0137acb15', 'request_id': 'req-3aff569f-e08c-4b0d-9eab-7493131c7258'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.626720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eea26ca14f4ca68a18f4e0137acb15', 'request_id': 'req-3aff569f-e08c-4b0d-9eab-7493131c7258'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.630481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 990/2013] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:51.637659 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] The token cache is being invalidate because project 14eea26ca14f4ca68a18f4e0137acb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:51.637960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.638944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.639242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.639365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.639516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.640875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1024/2014] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:51 2022] DELETE /identity/v3/projects/14eea26ca14f4ca68a18f4e0137acb15 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:51.657512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:51.657512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:51.662970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:51.664117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:51.664482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff569f-e08c-4b0d-9eab-7493131c7258 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:51.669245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:51.670143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.670419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.670874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] PATH_INFO: `/v3/users/346e4db7af414c9381994cd5b7b3d962` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.672274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=346e4db7af414c9381994cd5b7b3d962)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:51.673279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 991/2015] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:51.677697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:51.678166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:51.689371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd553e3-9238-4c00-b154-5d2f8ec518a2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:51.694312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:51.694983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.695264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.695540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.696407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:51.696786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:51.698447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:51.712463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 992/2016] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:51.716658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:51.727421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856ea5-d389-4619-9ddd-398170aa7dc5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:51.732159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:51.732823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.733108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.733386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.734075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:51.736003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:51.836370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 993/2017] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:51 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:51.840398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:51.864848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346e4db7af414c9381994cd5b7b3d962'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.871735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346e4db7af414c9381994cd5b7b3d962'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.884399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346e4db7af414c9381994cd5b7b3d962'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.908855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f1eb4-0b6d-4fee-819e-575e6ef7951f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:51.913436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:51.914226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:51.914513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:51.914786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:51.915473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:51.917433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:51.976973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346e4db7af414c9381994cd5b7b3d962'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.977717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346e4db7af414c9381994cd5b7b3d962'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:51.984300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1025/2018] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:51 2022] DELETE /identity/v3/users/346e4db7af414c9381994cd5b7b3d962 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:52.028788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 994/2019] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:51 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:52.030461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.032062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:52.100088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2232-4ea0-43a3-b9d1-e982abb65cbb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.107715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.107715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.107715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.107715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.108112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.109035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.122300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1026/2020] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:52.123409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.134122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3124-48df-4022-8d23-0a721851b93f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.138958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6a121-b6de-433e-be9b-2f8ea124e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.139617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6a121-b6de-433e-be9b-2f8ea124e9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.139898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6a121-b6de-433e-be9b-2f8ea124e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.140174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6a121-b6de-433e-be9b-2f8ea124e9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.140924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6a121-b6de-433e-be9b-2f8ea124e9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.143206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6a121-b6de-433e-be9b-2f8ea124e9a1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.153201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 995/2021] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:52.160346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.167874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65835-998f-4266-9750-53f107c33eec admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.172798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.173716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.173995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.174270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] PATH_INFO: `/v3/projects/7d89e481e53240e8be9a09c7a82f8595/users/50d6ad56fe3d4234a32f992728a2063f/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.190305 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d89e481e53240e8be9a09c7a82f8595, user_id=50d6ad56fe3d4234a32f992728a2063f, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.193032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.276297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1027/2022] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:52 2022] PUT /identity/v3/projects/7d89e481e53240e8be9a09c7a82f8595/users/50d6ad56fe3d4234a32f992728a2063f/roles/246514336b4549609174329cae41663a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:52.286718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.291296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.291296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.319306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] MFA Rules not processed for user `50d6ad56fe3d4234a32f992728a2063f`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:52.327721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:52.395749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 996/2023] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:52.400690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.408549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.412007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:52.485529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b249-2e45-4b5f-b828-6c6e84841339 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.485748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c2e25-cf46-41bb-bf42-858d4d677642 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.490798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.491650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.491789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.491932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.492205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] PATH_INFO: `/v3/projects/2c7a508dc31942ecae8e2f9f583e1a11` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.492464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.492898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.493185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.493432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7a508dc31942ecae8e2f9f583e1a11)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.493895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.495361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.496033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.637917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1028/2024] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:52 2022] POST /identity/v3/projects => generated 401 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:52.641791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.696217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7a508dc31942ecae8e2f9f583e1a11', 'request_id': 'req-b6c25386-4b7d-499e-9b5b-dc2384bdc202'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:52.703033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b692b-ae36-476b-92f1-f1fe06682c6a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.703444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7a508dc31942ecae8e2f9f583e1a11', 'request_id': 'req-b6c25386-4b7d-499e-9b5b-dc2384bdc202'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:52.710178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7a508dc31942ecae8e2f9f583e1a11', 'request_id': 'req-b6c25386-4b7d-499e-9b5b-dc2384bdc202'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:52.759718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.760565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.760852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.761131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.761821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.763761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.777899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] The token cache is being invalidate because project 2c7a508dc31942ecae8e2f9f583e1a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:52.778192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:52.778837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6c25386-4b7d-499e-9b5b-dc2384bdc202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:52.780396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 997/2025] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:52 2022] DELETE /identity/v3/projects/2c7a508dc31942ecae8e2f9f583e1a11 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:52.786479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc053c2-f45d-4df6-9398-c2816b863193 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.786772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc053c2-f45d-4df6-9398-c2816b863193 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.787058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc053c2-f45d-4df6-9398-c2816b863193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.806753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-fdc053c2-f45d-4df6-9398-c2816b863193 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:52.807988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-fdc053c2-f45d-4df6-9398-c2816b863193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:52.815949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 998/2026] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:52.823615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.828214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.828214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.841813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:52.842989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:52.852301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 999/2027] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:52.856871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.866156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58daabe9-6fc9-4bc1-a29a-688792f04283 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.870835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.871468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.871752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.872029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.872776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:52.873109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.874689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.882234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1029/2028] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:52 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:52.889448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1000/2029] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:33:52.889587 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.889587 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:52.890235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.899729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54fa1-0d3b-4e77-9596-5965548824aa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.899902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d411f4-24f9-4af8-b47d-4fbe9de95666 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.904492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.904633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.905135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.905259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.905411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.905508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.905737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.905849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.906361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.906484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.908567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.908803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:52.923658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1030/2030] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:52.928704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:52.938541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43493b59-d4af-4890-aeaa-4413da542fc6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:52.943514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:52.944387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:52.944710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:52.945512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] PATH_INFO: `/v3/projects/7e09e1a87a284cdeab1c6bab564ec76d/users/2f80fead161048f1898aee87b47c7c83/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:52.961085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e09e1a87a284cdeab1c6bab564ec76d, user_id=2f80fead161048f1898aee87b47c7c83, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:52.963742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.014957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1001/2031] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:52 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:53.017998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.040934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1031/2032] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:52 2022] PUT /identity/v3/projects/7e09e1a87a284cdeab1c6bab564ec76d/users/2f80fead161048f1898aee87b47c7c83/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:53.044821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.083413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2dbd8-10be-47e1-a625-f6f490688834 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.109420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3726c-6fc1-4090-97d4-a620e10b1d39 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.115827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.116598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.116884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.117156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.117883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.119556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.130091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1032/2033] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:53.135291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.150509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10dbb-a9fa-43d5-804a-8b118b0a874f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.150805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.151482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.151769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.152049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.152827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.154766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.155548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e862-3adc-4d87-8fd4-e0bd85e73b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.156439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e862-3adc-4d87-8fd4-e0bd85e73b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.156737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e862-3adc-4d87-8fd4-e0bd85e73b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.157014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e862-3adc-4d87-8fd4-e0bd85e73b59 admin admin] PATH_INFO: `/v3/projects/7e09e1a87a284cdeab1c6bab564ec76d/users/2f80fead161048f1898aee87b47c7c83/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.159695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e862-3adc-4d87-8fd4-e0bd85e73b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e09e1a87a284cdeab1c6bab564ec76d, user_id=2f80fead161048f1898aee87b47c7c83, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.162566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e862-3adc-4d87-8fd4-e0bd85e73b59 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.173623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1033/2034] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:53 2022] PUT /identity/v3/projects/7e09e1a87a284cdeab1c6bab564ec76d/users/2f80fead161048f1898aee87b47c7c83/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:53.187047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.187337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.187610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.219611 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] MFA Rules not processed for user `2f80fead161048f1898aee87b47c7c83`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:53.221452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:53.230286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1002/2035] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:53 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:53.234346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.243819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3824-087b-4a9a-970f-086eaf6c6410 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.300754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1034/2036] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:53.315599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.317411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:53.331249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.331990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.332296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.332650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.333215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.334886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.348262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1003/2037] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:53.349987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.359650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6734d6-954e-4e87-848c-5eb1518b777f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.364445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.365139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.365424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.365701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.366421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.368010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.379803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1004/2038] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:53.384070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.388104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b936d-505d-4f6e-b932-a184258b7747 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.392829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b41031-e2b3-4d9d-93cf-ffa3b95f8051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.394121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b41031-e2b3-4d9d-93cf-ffa3b95f8051 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.394553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b41031-e2b3-4d9d-93cf-ffa3b95f8051 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.394977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b41031-e2b3-4d9d-93cf-ffa3b95f8051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.395210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce0de1-8333-4b20-afc4-607c4fc774ed admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.400325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.401662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.401953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.402294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] PATH_INFO: `/v3/projects/6f7a929289be4bc284ca582927f53392/users/dcdfc9e355da4a509083988cabc385c0/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.406468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b41031-e2b3-4d9d-93cf-ffa3b95f8051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.408984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b41031-e2b3-4d9d-93cf-ffa3b95f8051 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.419240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7a929289be4bc284ca582927f53392, user_id=dcdfc9e355da4a509083988cabc385c0, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.422315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.424009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1035/2039] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:53.492976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1005/2040] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:53 2022] PUT /identity/v3/projects/6f7a929289be4bc284ca582927f53392/users/dcdfc9e355da4a509083988cabc385c0/roles/246514336b4549609174329cae41663a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:33:53.503492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.504115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.504642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.535259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] MFA Rules not processed for user `dcdfc9e355da4a509083988cabc385c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:53.536583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:53.612776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.622708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1036/2041] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:53.626956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.671533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abacc0-aa6c-40d8-9054-89fad800283d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.676246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.676975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.677260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.677538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.679388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:53.692698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15986f97-8932-4c37-8296-5900c6385a2f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.697539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.698183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.698465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.698740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.699426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.701368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.743847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.745507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.760520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1006/2042] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:33:53.785014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1037/2043] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:53 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:33:53.789001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.799730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e725f6-df41-4d3a-89c3-1a4ec95dd259 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.855202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.856031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.856316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.856654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.857342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.859729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.950552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1007/2044] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:53 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:53.955261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:53.968109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ca388-9427-48f6-97ec-e986c30b10e8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:53.975721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:53.976842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:53.977335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:53.979460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:53.979460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:53.980981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:53.991288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1038/2045] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:53.995461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:54.005206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9425a8-eedc-4dda-bdec-98e005f8726d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:54.010164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:54.011022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:54.011297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:54.011567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] PATH_INFO: `/v3/projects/9ff6d9c8dd8f4d63956882d0d716f0b0/users/1631b0b90b454396a0c55fdbb6014c31/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:54.026403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff6d9c8dd8f4d63956882d0d716f0b0, user_id=1631b0b90b454396a0c55fdbb6014c31, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:54.031125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:54.099272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1008/2046] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:53 2022] PUT /identity/v3/projects/9ff6d9c8dd8f4d63956882d0d716f0b0/users/1631b0b90b454396a0c55fdbb6014c31/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:54.103437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:54.113176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016c89-3f54-417e-9262-ef0dba2b885d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:54.168683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bab41-1186-40a0-b5b8-979e5d0a3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:54.169349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bab41-1186-40a0-b5b8-979e5d0a3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:54.169640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bab41-1186-40a0-b5b8-979e5d0a3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:54.169918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bab41-1186-40a0-b5b8-979e5d0a3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:54.170660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bab41-1186-40a0-b5b8-979e5d0a3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:54.172373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bab41-1186-40a0-b5b8-979e5d0a3d8c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:54.182319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1039/2047] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:33:54.186479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:54.197141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2e40f-c2e8-4512-a81a-f6d9a08d5d9d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:54.201833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:54.202649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:54.202962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:54.203240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] PATH_INFO: `/v3/projects/9ff6d9c8dd8f4d63956882d0d716f0b0/users/1631b0b90b454396a0c55fdbb6014c31/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:54.206111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff6d9c8dd8f4d63956882d0d716f0b0, user_id=1631b0b90b454396a0c55fdbb6014c31, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:54.208814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:54.219810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1009/2048] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:54 2022] PUT /identity/v3/projects/9ff6d9c8dd8f4d63956882d0d716f0b0/users/1631b0b90b454396a0c55fdbb6014c31/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:54.231730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:54.231993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:54.232266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:54.267015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] MFA Rules not processed for user `1631b0b90b454396a0c55fdbb6014c31`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:54.268929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:54.339379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1040/2049] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:54.348878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:54.405075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7e66-98c4-40ea-9ca5-0a777e7246f7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:54.408888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf511bf-849b-40dd-89ac-a1483ccfe76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:54.409548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf511bf-849b-40dd-89ac-a1483ccfe76d service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:54.409829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf511bf-849b-40dd-89ac-a1483ccfe76d service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:54.410100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf511bf-849b-40dd-89ac-a1483ccfe76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:54.419244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf511bf-849b-40dd-89ac-a1483ccfe76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:54.420726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf511bf-849b-40dd-89ac-a1483ccfe76d service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:54.430770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1010/2050] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:57.182646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:57.255534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6c6c-c4cf-4aee-9051-ed7c7925c358 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:57.270045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:57.270045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:57.270045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:57.270045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] PATH_INFO: `/v3/users/dcdfc9e355da4a509083988cabc385c0` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:57.270448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcdfc9e355da4a509083988cabc385c0)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:57.270448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:57.414177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcdfc9e355da4a509083988cabc385c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:57.420880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcdfc9e355da4a509083988cabc385c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:57.432507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcdfc9e355da4a509083988cabc385c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:57.509116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcdfc9e355da4a509083988cabc385c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:57.509681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcdfc9e355da4a509083988cabc385c0'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:57.516028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1041/2051] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:57 2022] DELETE /identity/v3/users/dcdfc9e355da4a509083988cabc385c0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:57.520613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:57.521078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:57.521225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:57.539855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:57.541095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:57.597459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1011/2052] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:57.607231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:57.608854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:57.670563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9636c2-35a6-44e0-859f-d2c24a578ffa admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:57.674815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:57.675464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:57.675748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:57.676026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:57.685903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:57.687390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:57.697673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1042/2053] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:58.080899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:58.080899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:58.085949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed1ce-8abc-46ed-950d-a3c5a38deacc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:58.090739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:58.091663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:58.091942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:58.092218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] PATH_INFO: `/v3/projects/6f7a929289be4bc284ca582927f53392` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:58.093784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7a929289be4bc284ca582927f53392)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:58.096236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:58.201630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7a929289be4bc284ca582927f53392', 'request_id': 'req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.207732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7a929289be4bc284ca582927f53392', 'request_id': 'req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.213183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7a929289be4bc284ca582927f53392', 'request_id': 'req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.269109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] The token cache is being invalidate because project 6f7a929289be4bc284ca582927f53392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:58.269440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.270096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.271704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1012/2054] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:58 2022] DELETE /identity/v3/projects/6f7a929289be4bc284ca582927f53392 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:58.275765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:58.286290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685bd70-9595-4706-a4e9-220a64b16f8c service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:58.341920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:58.342707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:58.342989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:58.343261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] PATH_INFO: `/v3/users/1631b0b90b454396a0c55fdbb6014c31` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:58.344493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1631b0b90b454396a0c55fdbb6014c31)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:58.347064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:58.549715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1631b0b90b454396a0c55fdbb6014c31'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.556386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1631b0b90b454396a0c55fdbb6014c31'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.567489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1631b0b90b454396a0c55fdbb6014c31'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.698137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1631b0b90b454396a0c55fdbb6014c31'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.698775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-957c31ea-335d-44c0-afce-8cb0bdf57c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1631b0b90b454396a0c55fdbb6014c31'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:58.706371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1043/2055] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:58 2022] DELETE /identity/v3/users/1631b0b90b454396a0c55fdbb6014c31 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:59.122989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.124419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:59.140973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6c69a-cf0b-42fa-87f1-cd4110e7b50e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.196928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.197777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.198060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.198336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] PATH_INFO: `/v3/projects/9ff6d9c8dd8f4d63956882d0d716f0b0` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.199512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff6d9c8dd8f4d63956882d0d716f0b0)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.201433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.303871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff6d9c8dd8f4d63956882d0d716f0b0', 'request_id': 'req-9f1df129-3a80-4b1e-94a5-0d696d06fc92'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.309815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff6d9c8dd8f4d63956882d0d716f0b0', 'request_id': 'req-9f1df129-3a80-4b1e-94a5-0d696d06fc92'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.315745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff6d9c8dd8f4d63956882d0d716f0b0', 'request_id': 'req-9f1df129-3a80-4b1e-94a5-0d696d06fc92'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.383571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] The token cache is being invalidate because project 9ff6d9c8dd8f4d63956882d0d716f0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:33:59.383851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.384501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f1df129-3a80-4b1e-94a5-0d696d06fc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.386022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1013/2056] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:33:59 2022] DELETE /identity/v3/projects/9ff6d9c8dd8f4d63956882d0d716f0b0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:33:59.392306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.392851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.392851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.410925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:59.411740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:59.474682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1044/2057] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:33:59.485518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.485805 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.486676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.506556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:33:59.507738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:59.516371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1014/2058] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:33:59.520460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.529773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb91e2-0448-4d35-a5f5-288f1ee3399b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.535619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.536336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.536652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.541554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.541554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:33:59.541554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.541554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.557159 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1045/2059] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:33:59.558248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.570239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb289d-83ea-417f-b07e-619312ec6b47 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.575507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.576295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.576709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.577052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.577815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.580006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.666765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1015/2060] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:33:59 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:59.670749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.681506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7c12-edba-46cf-a8cf-be433710f7f8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.706663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.709162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:59.741042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.741751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.742031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.742303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.742984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.744933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.773602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ffb54-1ab7-4b5a-8170-59f3b83606b0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.778273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.779134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.779420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.779698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] PATH_INFO: `/v3/users/50d6ad56fe3d4234a32f992728a2063f` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.780940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d6ad56fe3d4234a32f992728a2063f)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.783517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.830581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1046/2061] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:33:59 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:33:59.834612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.844246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8de6d-fb35-4afa-aac9-fd989a7504a7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.849553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.850347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.850464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.850736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.851443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.853075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.862562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1047/2062] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:59.866173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.875522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bb60-31d2-47c8-854c-04fac8230ac1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.881867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.881867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.881867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.881867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.882319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.883761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.894416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1048/2063] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:33:59.898180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:59.907744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e995a-cb23-4184-bc3a-d50550f1f9a9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:59.912950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db459b2-d9ce-4acf-97d3-bc577f4a5d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:59.913791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db459b2-d9ce-4acf-97d3-bc577f4a5d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:59.914095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db459b2-d9ce-4acf-97d3-bc577f4a5d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:59.914351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db459b2-d9ce-4acf-97d3-bc577f4a5d09 admin admin] PATH_INFO: `/v3/projects/45a05a6373f24c4fa5e78220ec7c14da/users/4cd2b95e7234402bb5420088b966a074/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:59.928160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db459b2-d9ce-4acf-97d3-bc577f4a5d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a05a6373f24c4fa5e78220ec7c14da, user_id=4cd2b95e7234402bb5420088b966a074, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:59.930797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db459b2-d9ce-4acf-97d3-bc577f4a5d09 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:59.968901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d6ad56fe3d4234a32f992728a2063f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.969575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d6ad56fe3d4234a32f992728a2063f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.976644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d6ad56fe3d4234a32f992728a2063f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.987851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d6ad56fe3d4234a32f992728a2063f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:33:59.988530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-25615638-9181-46b5-b013-693ecb56e9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d6ad56fe3d4234a32f992728a2063f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:00.035792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1049/2064] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:33:59 2022] PUT /identity/v3/projects/45a05a6373f24c4fa5e78220ec7c14da/users/4cd2b95e7234402bb5420088b966a074/roles/246514336b4549609174329cae41663a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:34:00.046992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:00.047286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:00.047568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:00.072707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] MFA Rules not processed for user `4cd2b95e7234402bb5420088b966a074`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:00.073908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:00.115570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1016/2065] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:33:59 2022] DELETE /identity/v3/users/50d6ad56fe3d4234a32f992728a2063f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:34:00.119969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:00.120836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:00.120836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:00.138413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:00.139600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1050/2066] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:34:00.139729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:00.152591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:00.153996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:00.206583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1017/2067] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:00.213566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:00.213855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab267d-59b5-43a3-a8d5-fb2d3d3b03ed None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:00.215052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:00.267013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:00.268230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:00.268547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:00.268829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:00.273075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f9401-e05e-4157-b72c-09c3e3a6238a None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:00.277244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:00.277883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:00.278165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:00.278437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:00.287334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:00.288784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:00.297743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1018/2068] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:34:00.324574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:00.326033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:00.335258 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1051/2069] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:34:00.791435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:00.793008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:00.807845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7066-bdc1-43f6-972a-a5526a2fddd8 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:00.813988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:00.815726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:00.816059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:00.816338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] PATH_INFO: `/v3/projects/7d89e481e53240e8be9a09c7a82f8595` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:00.817574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d89e481e53240e8be9a09c7a82f8595)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:00.819984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:00.937910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d89e481e53240e8be9a09c7a82f8595', 'request_id': 'req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:00.944075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d89e481e53240e8be9a09c7a82f8595', 'request_id': 'req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:00.949607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d89e481e53240e8be9a09c7a82f8595', 'request_id': 'req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.030776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] The token cache is being invalidate because project 7d89e481e53240e8be9a09c7a82f8595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:01.030994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.031719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.034058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1019/2070] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:00 2022] DELETE /identity/v3/projects/7d89e481e53240e8be9a09c7a82f8595 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:01.037795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:01.050847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2fdbd-40ea-4431-bdae-58c61ed73c2e service glance] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:01.106522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:01.107386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:01.107666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:01.107986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] PATH_INFO: `/v3/users/2f80fead161048f1898aee87b47c7c83` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:01.109230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f80fead161048f1898aee87b47c7c83)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:01.111829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:01.264199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f80fead161048f1898aee87b47c7c83'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.271808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f80fead161048f1898aee87b47c7c83'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.284076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f80fead161048f1898aee87b47c7c83'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.348605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f80fead161048f1898aee87b47c7c83'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.350027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a44701b6-85aa-4687-a954-eb235b5c6d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f80fead161048f1898aee87b47c7c83'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:01.357025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1052/2071] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:01 2022] DELETE /identity/v3/users/2f80fead161048f1898aee87b47c7c83 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:01.843784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:01.845521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:01.861325 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c934d1-a6a8-4472-86e4-4e22f1ed37bd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:01.929699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:01.930562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:01.930841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:01.931142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] PATH_INFO: `/v3/projects/7e09e1a87a284cdeab1c6bab564ec76d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:01.932274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e09e1a87a284cdeab1c6bab564ec76d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:01.934256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.041418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e09e1a87a284cdeab1c6bab564ec76d', 'request_id': 'req-a284aedb-6849-4992-8133-f5676a5056bd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:02.047563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e09e1a87a284cdeab1c6bab564ec76d', 'request_id': 'req-a284aedb-6849-4992-8133-f5676a5056bd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:02.053277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e09e1a87a284cdeab1c6bab564ec76d', 'request_id': 'req-a284aedb-6849-4992-8133-f5676a5056bd'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:02.109785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] The token cache is being invalidate because project 7e09e1a87a284cdeab1c6bab564ec76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:02.110078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:02.110708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a284aedb-6849-4992-8133-f5676a5056bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:02.112817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1020/2072] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:01 2022] DELETE /identity/v3/projects/7e09e1a87a284cdeab1c6bab564ec76d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:02.119795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.120265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.120376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.139372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:02.140621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:02.202661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1053/2073] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:02.210417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959c76-7255-46df-afaa-75680c99726d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.210702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959c76-7255-46df-afaa-75680c99726d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.210979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959c76-7255-46df-afaa-75680c99726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.234841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3e959c76-7255-46df-afaa-75680c99726d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:02.236658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3e959c76-7255-46df-afaa-75680c99726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:02.253768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1021/2074] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:02.258226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.268102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9bec5-c5f8-4de9-93d1-8754fad8cb30 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.273825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.274519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.274805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.275080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.275806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:34:02.276113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.277793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.289694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1054/2075] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:34:02.296733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e959c76-7255-46df-afaa-75680c99726d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.306358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e959c76-7255-46df-afaa-75680c99726d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.310971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.311614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.311899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.312182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.312919 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.315487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.402513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1022/2076] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:34:02 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:02.406717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.416963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821dbd5-9606-4fba-8d8f-8d5cfb16779a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.476502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.477177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.477462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.477740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.478448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.480376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.602207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1055/2077] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:34:02 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:02.606238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.618131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3408-edb7-4ca1-a6b3-e6798901d0ff admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.628698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.629397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.629674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.629950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.630673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.632255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.643551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1023/2078] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:34:02.647789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.658279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0c431-6d31-4416-98f3-ced084023647 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.662988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218369-4106-46fc-a689-65c6b1a7bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.663645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218369-4106-46fc-a689-65c6b1a7bc61 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.663927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218369-4106-46fc-a689-65c6b1a7bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.664199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218369-4106-46fc-a689-65c6b1a7bc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.664951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218369-4106-46fc-a689-65c6b1a7bc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.673218 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218369-4106-46fc-a689-65c6b1a7bc61 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.679731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1056/2079] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:34:02.683750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.694012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211170-b50b-4dfb-9256-ebe6349194ea admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.698983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.699869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.700150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.702282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] PATH_INFO: `/v3/projects/725550a720a94cfca9bf13299c80ce4f/users/cf92c298b75a4f42b95bf19b77852358/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.716879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=725550a720a94cfca9bf13299c80ce4f, user_id=cf92c298b75a4f42b95bf19b77852358, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.719581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.785371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1024/2080] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:34:02 2022] PUT /identity/v3/projects/725550a720a94cfca9bf13299c80ce4f/users/cf92c298b75a4f42b95bf19b77852358/roles/246514336b4549609174329cae41663a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:34:02.796863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.797152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.797469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.824303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] MFA Rules not processed for user `cf92c298b75a4f42b95bf19b77852358`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:02.825536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:02.898686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1057/2081] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:34:02.909659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:02.911353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:02.966407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65e03a-eec1-4538-b9b8-a9fc0623bcdc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:02.970824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485a0ed-2232-4909-bfc6-52a52b2299c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:02.972206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a0ed-2232-4909-bfc6-52a52b2299c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:02.972462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a0ed-2232-4909-bfc6-52a52b2299c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:02.972742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a0ed-2232-4909-bfc6-52a52b2299c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:02.981357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485a0ed-2232-4909-bfc6-52a52b2299c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:02.982867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485a0ed-2232-4909-bfc6-52a52b2299c9 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:02.991235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1025/2082] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:03.016384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:03.080418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ae4cc-d297-4d7e-b7c5-2ff867a4eb07 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:03.085141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:03.086162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:03.086443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:03.086718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] PATH_INFO: `/v3/users/cf92c298b75a4f42b95bf19b77852358` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:03.087937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf92c298b75a4f42b95bf19b77852358)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:03.089928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:03.289505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf92c298b75a4f42b95bf19b77852358'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:03.296884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf92c298b75a4f42b95bf19b77852358'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:03.308456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf92c298b75a4f42b95bf19b77852358'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:03.366675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf92c298b75a4f42b95bf19b77852358'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:03.367365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf92c298b75a4f42b95bf19b77852358'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:03.373876 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1058/2083] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:03 2022] DELETE /identity/v3/users/cf92c298b75a4f42b95bf19b77852358 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:03.379125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:03.379411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:03.379712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:03.397140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:03.398301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:03.454012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1026/2084] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:03.464369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:03.465839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:03.528276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762919c-56fc-4f20-b61f-a083a9353090 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:03.532026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:03.532702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:03.532988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:03.533264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:03.542721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:03.544190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:03.554461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1059/2085] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:04.029904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:04.031357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:04.046765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a5794-755f-4e17-b391-06643797e4c7 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:04.052714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:04.060681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:04.060681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:04.060681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] PATH_INFO: `/v3/projects/725550a720a94cfca9bf13299c80ce4f` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:04.060681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=725550a720a94cfca9bf13299c80ce4f)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:04.060681 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:04.186244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725550a720a94cfca9bf13299c80ce4f', 'request_id': 'req-56c87a5b-c997-4490-b6a9-5ac2081338ea'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:04.192843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725550a720a94cfca9bf13299c80ce4f', 'request_id': 'req-56c87a5b-c997-4490-b6a9-5ac2081338ea'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:04.199110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725550a720a94cfca9bf13299c80ce4f', 'request_id': 'req-56c87a5b-c997-4490-b6a9-5ac2081338ea'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:04.291490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] The token cache is being invalidate because project 725550a720a94cfca9bf13299c80ce4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:04.295636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:04.295636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-56c87a5b-c997-4490-b6a9-5ac2081338ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:04.295636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1027/2086] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:04 2022] DELETE /identity/v3/projects/725550a720a94cfca9bf13299c80ce4f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:19.724208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:19.725748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:19.802124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252813b-95a9-429e-bcb5-dac777dd3e68 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:19.856874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:19.857763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:19.858046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:19.858322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] PATH_INFO: `/v3/users/9eaee09e6e5b44c78804d27a577339cc` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:19.859551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eaee09e6e5b44c78804d27a577339cc)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:19.861596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:20.052691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eaee09e6e5b44c78804d27a577339cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.061707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eaee09e6e5b44c78804d27a577339cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.073679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eaee09e6e5b44c78804d27a577339cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.148786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eaee09e6e5b44c78804d27a577339cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.149403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eaee09e6e5b44c78804d27a577339cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.155253 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1060/2087] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:19 2022] DELETE /identity/v3/users/9eaee09e6e5b44c78804d27a577339cc => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:20.159787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:20.160231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:20.160345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:20.185915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:20.187104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:20.243350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1028/2088] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:20.253776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:20.255192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:20.345796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc5e87-1371-4b6a-9d70-de76e95ed8fd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:20.349447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4201c37-ad27-4ee0-a86d-6a7998d04900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:20.350115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201c37-ad27-4ee0-a86d-6a7998d04900 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:20.350391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201c37-ad27-4ee0-a86d-6a7998d04900 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:20.350665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201c37-ad27-4ee0-a86d-6a7998d04900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:20.359895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4201c37-ad27-4ee0-a86d-6a7998d04900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:20.361344 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4201c37-ad27-4ee0-a86d-6a7998d04900 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:20.371198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1061/2089] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:20.751069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:20.754501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:20.766288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d215d42-4187-4f2f-ab75-b91c0f57b447 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:20.770933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:20.776612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:20.776612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:20.776612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] PATH_INFO: `/v3/projects/b6d0e45a333e45b6ab3f53e8dddbbb62` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:20.776612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d0e45a333e45b6ab3f53e8dddbbb62)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:20.777769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:20.893685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d0e45a333e45b6ab3f53e8dddbbb62', 'request_id': 'req-fe0ee616-f336-4110-8b6c-8b9b326be082'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.900481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d0e45a333e45b6ab3f53e8dddbbb62', 'request_id': 'req-fe0ee616-f336-4110-8b6c-8b9b326be082'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.906092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d0e45a333e45b6ab3f53e8dddbbb62', 'request_id': 'req-fe0ee616-f336-4110-8b6c-8b9b326be082'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.977440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] The token cache is being invalidate because project b6d0e45a333e45b6ab3f53e8dddbbb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:20.977731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.978409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe0ee616-f336-4110-8b6c-8b9b326be082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:20.979979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1029/2090] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:20 2022] DELETE /identity/v3/projects/b6d0e45a333e45b6ab3f53e8dddbbb62 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:20.985022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:20.985540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:20.985653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.024675 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:21.025982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:21.083636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1062/2091] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:21.091717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.092014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.092295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.110204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:21.111381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:21.119284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1030/2092] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:21.123411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.133547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641226c-dc4f-4cd6-800a-b6dcfed73746 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.138099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.138738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.139019 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.139292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.140012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:34:21.140318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.142053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.159208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1063/2093] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:34:21.163564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.172633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6296997-ed73-4296-b3a2-b0bd00be00bc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.177482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.178131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.178414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.178692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.179409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.181363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.269000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1031/2094] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:34:21 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:21.273010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.283249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644b7-156f-43d2-8530-2ab992200fe9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.336980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.337653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.337926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.338206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.338893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.340843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.411518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1064/2095] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:34:21 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:34:21.415675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.425629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb747e77-7f75-491f-b61d-712c65555952 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.430810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.431353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.431669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.431926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.432669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.434251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.444405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1032/2096] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:34:21.449095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.459723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e1d4-f4ce-429b-9508-1ad9c3867e74 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.464458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9080-7a8b-436c-a159-16b447deb768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.465133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9080-7a8b-436c-a159-16b447deb768 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.465412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9080-7a8b-436c-a159-16b447deb768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.465685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9080-7a8b-436c-a159-16b447deb768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.466399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9080-7a8b-436c-a159-16b447deb768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.467995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9080-7a8b-436c-a159-16b447deb768 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.477955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1065/2097] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:34:21.482164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.491875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16ea2-a7ff-434e-87fe-d3c16748472f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.496987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.497852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.498129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.498400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] PATH_INFO: `/v3/projects/7ab087ec021743f6847c0c3adba18826/users/f01a290271f243c784c2bd0de6394e2b/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.514105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab087ec021743f6847c0c3adba18826, user_id=f01a290271f243c784c2bd0de6394e2b, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.522845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.611962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1033/2098] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:34:21 2022] PUT /identity/v3/projects/7ab087ec021743f6847c0c3adba18826/users/f01a290271f243c784c2bd0de6394e2b/roles/246514336b4549609174329cae41663a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:34:21.622760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b1c90-75dc-41af-9648-406cf8170d76 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.623055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b1c90-75dc-41af-9648-406cf8170d76 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.623337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b1c90-75dc-41af-9648-406cf8170d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.650411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b28b1c90-75dc-41af-9648-406cf8170d76 None None] MFA Rules not processed for user `f01a290271f243c784c2bd0de6394e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:21.651628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b28b1c90-75dc-41af-9648-406cf8170d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:21.719736 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1066/2099] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:21.729730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:21.731393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:21.786497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7ce3-eb1d-453e-9de2-a519a634fc77 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:21.790652 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:21.791288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:21.791597 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:21.791849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:21.800199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:21.801765 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:21.811098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1034/2100] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:44.902013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92619-f473-4690-99e3-a528db6bce25 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:44.902509 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92619-f473-4690-99e3-a528db6bce25 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:44.902625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92619-f473-4690-99e3-a528db6bce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:44.920548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-95b92619-f473-4690-99e3-a528db6bce25 None None] MFA Rules not processed for user `35d4828335a543758d1413c0276657a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:44.921775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-95b92619-f473-4690-99e3-a528db6bce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:44.974572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1067/2101] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:57.519447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:57.582899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27892-ec24-45db-947f-5a0c62e531c6 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:57.588098 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:57.588993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:57.589275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:57.589547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] PATH_INFO: `/v3/users/f01a290271f243c784c2bd0de6394e2b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:57.590738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01a290271f243c784c2bd0de6394e2b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:57.592709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:57.738240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01a290271f243c784c2bd0de6394e2b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:57.738815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01a290271f243c784c2bd0de6394e2b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:57.745333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01a290271f243c784c2bd0de6394e2b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:57.756646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01a290271f243c784c2bd0de6394e2b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:57.757284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01a290271f243c784c2bd0de6394e2b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:57.810442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1035/2102] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:57 2022] DELETE /identity/v3/users/f01a290271f243c784c2bd0de6394e2b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:57.815181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:57.815770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:57.815770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:57.834060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:57.835236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:57.890614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1068/2103] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:57.901049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:57.902740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:57.962538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919928-6a91-4e4d-9b82-807a9f93628e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:57.966373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2813a-dca2-4c2e-a90c-a8b46e990205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:57.967047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2813a-dca2-4c2e-a90c-a8b46e990205 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:57.967333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2813a-dca2-4c2e-a90c-a8b46e990205 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:57.967612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2813a-dca2-4c2e-a90c-a8b46e990205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:57.977669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2813a-dca2-4c2e-a90c-a8b46e990205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:57.979124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2813a-dca2-4c2e-a90c-a8b46e990205 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:57.989444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1036/2104] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:58.362948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:58.364781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:58.378367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb388f51-9766-48f7-abb5-2cde60691454 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:58.388414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:58.389322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:58.389597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:58.389869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] PATH_INFO: `/v3/projects/7ab087ec021743f6847c0c3adba18826` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:58.391074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab087ec021743f6847c0c3adba18826)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:58.393024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:58.520524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab087ec021743f6847c0c3adba18826', 'request_id': 'req-d2a69cb0-f471-4f10-928f-f8f5b407149c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:58.617864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab087ec021743f6847c0c3adba18826', 'request_id': 'req-d2a69cb0-f471-4f10-928f-f8f5b407149c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:58.625160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab087ec021743f6847c0c3adba18826', 'request_id': 'req-d2a69cb0-f471-4f10-928f-f8f5b407149c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:58.635998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] The token cache is being invalidate because project 7ab087ec021743f6847c0c3adba18826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:58.636296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:58.636986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d2a69cb0-f471-4f10-928f-f8f5b407149c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:58.638529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1069/2105] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:58 2022] DELETE /identity/v3/projects/7ab087ec021743f6847c0c3adba18826 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:58.643538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:58.644043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:58.645422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:58.680028 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:58.681291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:58.742889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1037/2106] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:58.750410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:58.750770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:58.751059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:58.772175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:58.773395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:58.781331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1070/2107] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:58.785536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:58.795956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33692846-f009-4ffc-a0d5-30d389659b5e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:58.802415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:58.803386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:58.803512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:58.803687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:58.805061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:34:58.805391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:58.807002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:58.819278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1038/2108] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:34:58.824006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:58.836418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a714-bd9c-483d-b89c-8dd795a000a7 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:58.841653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:58.842989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:58.843269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:58.843538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:58.844230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:58.846167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:58.956358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1071/2109] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:34:58 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:58.960320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:58.970615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0af04-73a8-4015-8e28-d4658e2affc1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:59.029088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:59.029769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:59.030055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:59.030339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:59.031047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:59.033044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:59.114454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1039/2110] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:34:58 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:34:59.118438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:59.128953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050f609-7872-4aec-b10f-fcb0e8db6e67 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:59.133880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:59.134529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:59.134812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:59.135088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:59.135844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:59.137537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:59.147824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1072/2111] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:34:59.153247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:59.164809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec5a6-8fcf-44cd-8d28-1f8aa726f89b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:59.170045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3260e-5003-4884-8a0f-6e173ebfe1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:59.170752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3260e-5003-4884-8a0f-6e173ebfe1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:59.171029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3260e-5003-4884-8a0f-6e173ebfe1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:59.171302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3260e-5003-4884-8a0f-6e173ebfe1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:59.172045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3260e-5003-4884-8a0f-6e173ebfe1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:59.173668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3260e-5003-4884-8a0f-6e173ebfe1cb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:59.184129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1040/2112] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:34:59.188396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:59.198920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c30a-704e-4519-9a63-c03e6e656f31 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:59.203697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:59.204718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:59.204922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:59.205200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] PATH_INFO: `/v3/projects/784f5427745d402ba47e692082aac30f/users/c250b028df424333b3a2a87b54fcaef2/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:59.219751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784f5427745d402ba47e692082aac30f, user_id=c250b028df424333b3a2a87b54fcaef2, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:59.222640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:59.280845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1073/2113] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:34:59 2022] PUT /identity/v3/projects/784f5427745d402ba47e692082aac30f/users/c250b028df424333b3a2a87b54fcaef2/roles/246514336b4549609174329cae41663a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:59.285898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d93f71-dcce-436b-a454-810957211324 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:59.287727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d93f71-dcce-436b-a454-810957211324 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:59.287727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d93f71-dcce-436b-a454-810957211324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:59.303745 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-70d93f71-dcce-436b-a454-810957211324 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:34:59.305027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-70d93f71-dcce-436b-a454-810957211324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:59.360552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1041/2114] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:34:59.369832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:59.371517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:59.425813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaf996-80d9-478d-9275-5d0570771879 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:59.429501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:59.430139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:59.430421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:59.430701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:59.439456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:59.440927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:59.451303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1074/2115] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:05.161600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.162058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.162149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.188314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] MFA Rules not processed for user `c250b028df424333b3a2a87b54fcaef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:05.189567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:05.254456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1042/2116] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:05.259529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.269008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64712a-6603-4208-86f4-899afb0cfb5e service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.274134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.274772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.275052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.275333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.276026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.277986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.361366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1075/2117] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:35:05 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:35:05.365433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.376015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39bb78-1661-4fa9-a0aa-f39b6d67fa80 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.433056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.433723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.434004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.434280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.434968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.436929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.492355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1043/2118] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:35:05 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:35:05.496087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.506864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489fefd-495c-425a-b643-3891c3ab1666 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.512412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.513363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.513623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.513900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.514625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.516254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.529598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1076/2119] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:35:05.536252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.546422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3def0-5a37-4b05-92d4-77856e2fc3c6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.551159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.552034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.552312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.552616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] PATH_INFO: `/v3/projects/73983354768a49ae82e4c10ad46857e7/users/16529c3b76c847d481b1d6876afb5368/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.568641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73983354768a49ae82e4c10ad46857e7, user_id=16529c3b76c847d481b1d6876afb5368, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.571962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.646111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1044/2120] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:35:05 2022] PUT /identity/v3/projects/73983354768a49ae82e4c10ad46857e7/users/16529c3b76c847d481b1d6876afb5368/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:05.649837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.660373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2995c5-fa17-4990-a90e-612526eb3359 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.716014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.716709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.716994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.717272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.717990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.719599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.729793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1077/2121] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:35:05.733965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.745173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737e4e-550e-429a-b654-fbab05496ac4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.750164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a498657-7a88-47f8-a113-3700b6a753bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.751048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498657-7a88-47f8-a113-3700b6a753bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.751328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498657-7a88-47f8-a113-3700b6a753bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.751603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498657-7a88-47f8-a113-3700b6a753bc admin admin] PATH_INFO: `/v3/projects/73983354768a49ae82e4c10ad46857e7/users/16529c3b76c847d481b1d6876afb5368/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.753742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a498657-7a88-47f8-a113-3700b6a753bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=73983354768a49ae82e4c10ad46857e7, user_id=16529c3b76c847d481b1d6876afb5368, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.756413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a498657-7a88-47f8-a113-3700b6a753bc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.769465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1045/2122] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:35:05 2022] PUT /identity/v3/projects/73983354768a49ae82e4c10ad46857e7/users/16529c3b76c847d481b1d6876afb5368/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:12.298333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:12.300125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:12.330035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:12.330574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:12.330574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:12.358322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] MFA Rules not processed for user `16529c3b76c847d481b1d6876afb5368`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:12.359562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:12.405183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc49cb-ec18-490a-b501-00897beae551 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:12.454195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1046/2123] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:35:12.466501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:12.467988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:12.481043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:12.481691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:12.481969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:12.482244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:12.484032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:12.495707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:12.497334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242aa6d-f955-4274-936c-8a1b848bb913 service placement] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:12.508990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1078/2124] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:12.549957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eafc3a-6a61-4fe9-b5c6-a67cc9a51f48 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:12.554161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:12.554799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:12.555080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:12.555351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:12.611116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:12.612619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:12.622162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1047/2125] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:35:12.867755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:12.867755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:12.867755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:12.938483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:12.941830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:13.047809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1079/2126] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:13.111787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:13.113323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:13.231478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b247-3950-48f0-887c-d89b377e781a service glance] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:13.241147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aaac3-3748-4199-9984-f45e9800ba9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:13.241967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aaac3-3748-4199-9984-f45e9800ba9a service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:13.242503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aaac3-3748-4199-9984-f45e9800ba9a service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:13.243049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aaac3-3748-4199-9984-f45e9800ba9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:13.257554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aaac3-3748-4199-9984-f45e9800ba9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:13.260027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aaac3-3748-4199-9984-f45e9800ba9a service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:13.270179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1048/2127] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:35:14.393915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:14.396370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:14.489832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace94dc-46ca-4d01-8ad4-f0194debb518 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:14.495916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:14.497136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:14.500282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:14.500282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] PATH_INFO: `/v3/users/4cd2b95e7234402bb5420088b966a074` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:14.500282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd2b95e7234402bb5420088b966a074)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:14.501693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:14.777110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd2b95e7234402bb5420088b966a074'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:14.789402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd2b95e7234402bb5420088b966a074'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:14.805265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd2b95e7234402bb5420088b966a074'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:14.891683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd2b95e7234402bb5420088b966a074'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:14.892415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd2b95e7234402bb5420088b966a074'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:14.903704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1080/2128] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:35:14 2022] DELETE /identity/v3/users/4cd2b95e7234402bb5420088b966a074 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:14.907847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:14.908352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:14.908460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:14.945363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:14.946940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:15.034471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1049/2129] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:15.039359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:15.040936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:15.128905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4e5b-82fd-4dc9-b596-59f10f6d47e3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:15.140445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694409f-9976-48c5-9035-7adbab9f9aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:15.141870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694409f-9976-48c5-9035-7adbab9f9aea service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:15.142259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694409f-9976-48c5-9035-7adbab9f9aea service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:15.142935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694409f-9976-48c5-9035-7adbab9f9aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:15.173656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694409f-9976-48c5-9035-7adbab9f9aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:15.175131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694409f-9976-48c5-9035-7adbab9f9aea service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:15.186381 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1081/2130] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:15.794879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:15.796662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:15.818865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62452f-e7ad-4c0f-bd5c-332d2bbd5b85 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:15.830490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:15.831369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:15.831654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:15.831934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] PATH_INFO: `/v3/projects/45a05a6373f24c4fa5e78220ec7c14da` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:15.837465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a05a6373f24c4fa5e78220ec7c14da)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:15.839426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.005789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a05a6373f24c4fa5e78220ec7c14da', 'request_id': 'req-516ef88c-37e5-45e1-a183-2de0fddf6330'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:16.016366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a05a6373f24c4fa5e78220ec7c14da', 'request_id': 'req-516ef88c-37e5-45e1-a183-2de0fddf6330'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:16.022808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a05a6373f24c4fa5e78220ec7c14da', 'request_id': 'req-516ef88c-37e5-45e1-a183-2de0fddf6330'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:16.097783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] The token cache is being invalidate because project 45a05a6373f24c4fa5e78220ec7c14da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:35:16.098454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:16.099271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-516ef88c-37e5-45e1-a183-2de0fddf6330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:35:16.107134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1050/2131] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:35:15 2022] DELETE /identity/v3/projects/45a05a6373f24c4fa5e78220ec7c14da => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:16.107606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.108083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.108212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.141568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:16.142982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:16.241772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1082/2132] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:16.243770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.244736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.244736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.267996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:16.269329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:16.282365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1051/2133] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:35:16.286685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.299778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f930f-a102-4838-9b96-6ca9d3fedf12 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:16.305131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:16.306128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.306408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.306682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.307476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:35:16.307787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:16.309586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.328778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1083/2134] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:35:16.331359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.341838 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f9922-dc30-4242-a820-5cc109bbe2f7 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:16.347584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:16.348549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.348956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.349328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.350146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:16.352815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.459332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1052/2135] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:35:16 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:35:16.461334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.473464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf10ae-b4db-46fa-9804-4736f3025481 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:16.552929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:16.554035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.554498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.554944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.555647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:16.557657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.649799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1084/2136] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:35:16 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:35:16.654550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.672930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64f27-f1de-47c9-95f8-4da0c624b44e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:16.678880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:16.679570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.680077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.680359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.681137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:16.682781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.700079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1053/2137] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:35:16.700299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.711579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e118e-648a-46f4-baa7-93f1a19d0627 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:16.722304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d837-85a8-49c7-a22d-614afd48f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:16.723156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d837-85a8-49c7-a22d-614afd48f674 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.723541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d837-85a8-49c7-a22d-614afd48f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.723927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d837-85a8-49c7-a22d-614afd48f674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.724922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3d837-85a8-49c7-a22d-614afd48f674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:16.726817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3d837-85a8-49c7-a22d-614afd48f674 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.741783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1085/2138] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:35:16.742762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.761524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491f1e2-337f-4e6c-abe1-92af8216a5be admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:16.766493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:16.767383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.767661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.767929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] PATH_INFO: `/v3/projects/360e1042eb3f47f5be6a603e1877d9d8/users/07356563a079427b97e47ce2a11b54b7/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.786068 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=360e1042eb3f47f5be6a603e1877d9d8, user_id=07356563a079427b97e47ce2a11b54b7, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:16.788908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:16.863456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1054/2139] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:35:16 2022] PUT /identity/v3/projects/360e1042eb3f47f5be6a603e1877d9d8/users/07356563a079427b97e47ce2a11b54b7/roles/246514336b4549609174329cae41663a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:35:16.869588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbd7cd-1330-47b0-8b55-cd0eea5eda9a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:16.870009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbd7cd-1330-47b0-8b55-cd0eea5eda9a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:16.870410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbd7cd-1330-47b0-8b55-cd0eea5eda9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:16.893293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6ffbd7cd-1330-47b0-8b55-cd0eea5eda9a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:16.894903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6ffbd7cd-1330-47b0-8b55-cd0eea5eda9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:16.965668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1086/2140] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:35:16.977788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:16.979554 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:17.040297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98080ac-62a9-4139-a862-571cc232d1bb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:17.044313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:17.045053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:17.045304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:17.045581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:17.056487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:17.057957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:17.068651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1055/2141] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:24.255013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:24.255542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:24.255542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:24.318583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] MFA Rules not processed for user `07356563a079427b97e47ce2a11b54b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:24.319861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:24.437064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1087/2142] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:24.442147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:24.452591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7762-1664-4812-8c53-662dfdeac1e3 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:24.458102 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:24.458997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:24.459970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:24.460242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:24.461304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:24.463469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:24.594776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1056/2143] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:35:24 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:35:24.601527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:24.622488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff3556-2b55-47b9-9c9b-f583b571a16a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:24.707016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:24.707981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:24.708419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:24.708891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:24.710471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:24.712660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:24.862829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1088/2144] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:35:24 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:35:24.868117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:24.878523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a97a-6dc3-44cc-8b57-74dda70cb8b7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:24.886169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:24.886846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:24.887122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:24.887440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:24.888283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:24.889913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:24.907435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1057/2145] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:35:24.907664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:24.918196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0050d9-4289-4f6a-8f1c-34414321b072 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:24.924385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:24.924385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:24.924385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:24.924771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] PATH_INFO: `/v3/projects/9af84fdd4f364c28821c9c8ce4ed812d/users/d09cd0b15e3d4305b7831fcf580e081a/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:24.944266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af84fdd4f364c28821c9c8ce4ed812d, user_id=d09cd0b15e3d4305b7831fcf580e081a, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:24.947037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:25.002642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1089/2146] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:35:24 2022] PUT /identity/v3/projects/9af84fdd4f364c28821c9c8ce4ed812d/users/d09cd0b15e3d4305b7831fcf580e081a/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:25.006959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:25.017766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b205ba0-8c1e-4b40-be58-41271a23e6fa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:25.116149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790969-3c1b-4f60-a7b8-8487da43f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:25.117271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790969-3c1b-4f60-a7b8-8487da43f104 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:25.117781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790969-3c1b-4f60-a7b8-8487da43f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:25.118295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790969-3c1b-4f60-a7b8-8487da43f104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:25.119181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790969-3c1b-4f60-a7b8-8487da43f104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:25.121200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790969-3c1b-4f60-a7b8-8487da43f104 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:25.143489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1058/2147] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:35:25.151552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:25.170061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968820e0-288a-4b08-afb6-c51780ebdf33 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:25.176206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cfe00-1018-46cf-a64d-e0f5b5ced3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:25.177319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cfe00-1018-46cf-a64d-e0f5b5ced3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:25.177706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cfe00-1018-46cf-a64d-e0f5b5ced3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:25.188032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cfe00-1018-46cf-a64d-e0f5b5ced3ad admin admin] PATH_INFO: `/v3/projects/9af84fdd4f364c28821c9c8ce4ed812d/users/d09cd0b15e3d4305b7831fcf580e081a/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:25.194585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cfe00-1018-46cf-a64d-e0f5b5ced3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af84fdd4f364c28821c9c8ce4ed812d, user_id=d09cd0b15e3d4305b7831fcf580e081a, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:25.198348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cfe00-1018-46cf-a64d-e0f5b5ced3ad admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:25.217426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1090/2148] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:35:25 2022] PUT /identity/v3/projects/9af84fdd4f364c28821c9c8ce4ed812d/users/d09cd0b15e3d4305b7831fcf580e081a/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:28.282872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:28.283346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:28.283453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:28.303543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] MFA Rules not processed for user `c250b028df424333b3a2a87b54fcaef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:28.305302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:28.376669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1059/2149] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:32.392196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f293a2-1cae-4b4c-948a-6d63833d7a9b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:32.392769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f293a2-1cae-4b4c-948a-6d63833d7a9b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:32.392978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f293a2-1cae-4b4c-948a-6d63833d7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:32.441628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-92f293a2-1cae-4b4c-948a-6d63833d7a9b None None] MFA Rules not processed for user `d09cd0b15e3d4305b7831fcf580e081a`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:32.444306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-92f293a2-1cae-4b4c-948a-6d63833d7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:32.559224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1091/2150] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:35:32.572788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:32.573938 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:32.752125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983097-5359-4ff6-beda-bc74ad2a0fea None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:32.759529 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:32.760130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:32.760591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:32.760785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:32.766626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524e1a-f76b-4901-be19-0c3eaafade1f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:32.767128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524e1a-f76b-4901-be19-0c3eaafade1f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:32.767458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524e1a-f76b-4901-be19-0c3eaafade1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:32.790358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ba524e1a-f76b-4901-be19-0c3eaafade1f None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:32.791796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ba524e1a-f76b-4901-be19-0c3eaafade1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:32.824771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:32.838816 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:32.862783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1060/2151] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:32.871346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1092/2152] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:35:32.885130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:32.886716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:32.966174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1d9b6-85ab-45bf-bbdc-5854c3f70ca8 service nova] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:32.971593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:32.972244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:32.972570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:32.972851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:32.981290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:32.982913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:32.991124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1061/2153] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:35:36.928316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:36.928845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:36.928940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:36.951443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] MFA Rules not processed for user `07356563a079427b97e47ce2a11b54b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:35:36.952962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:36.969629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1093/2154] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:02.467202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:02.468659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:02.543539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5960-8981-41cf-8c89-339f4f3d1ec6 service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:02.548497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:02.549369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:02.549648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:02.549922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] PATH_INFO: `/v3/users/f213f03b8c094202b25d6a1fcccb5994` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:02.551364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f213f03b8c094202b25d6a1fcccb5994)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:02.553505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:02.738768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f213f03b8c094202b25d6a1fcccb5994'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:02.739346 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f213f03b8c094202b25d6a1fcccb5994'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:02.746143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f213f03b8c094202b25d6a1fcccb5994'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:02.757246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f213f03b8c094202b25d6a1fcccb5994'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:02.757927 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8893d3e2-67d2-4245-8a37-e745c0f0bce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f213f03b8c094202b25d6a1fcccb5994'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:02.803881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1062/2155] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:02 2022] DELETE /identity/v3/users/f213f03b8c094202b25d6a1fcccb5994 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:03.040481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.051637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b7b7b-d5e6-40ce-b971-1627a05f0d0f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.112667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.113532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.113810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.114084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] PATH_INFO: `/v3/projects/fa11c817930e42c49bb0f242205952d7` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.115312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa11c817930e42c49bb0f242205952d7)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.117429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.222073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa11c817930e42c49bb0f242205952d7', 'request_id': 'req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:03.284888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa11c817930e42c49bb0f242205952d7', 'request_id': 'req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:03.291677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa11c817930e42c49bb0f242205952d7', 'request_id': 'req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:03.301864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] The token cache is being invalidate because project fa11c817930e42c49bb0f242205952d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:03.302153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:03.303328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5024e5f9-7b60-4dc2-8d8b-76dc580cb4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:03.304939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1094/2156] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:03 2022] DELETE /identity/v3/projects/fa11c817930e42c49bb0f242205952d7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:03.309995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.310356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.310697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.330744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:03.332152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:03.402768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1063/2157] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:03.404399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.404725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.405008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.425266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:03.426455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:03.435081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1095/2158] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:03.439390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.449734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ca9a-4297-4945-acc8-2c2d8f029827 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.454688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.455477 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.455820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.456193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.457024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:03.457399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.459126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.470337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1064/2159] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:03.475211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.484524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fe7d3-2bd1-4f0d-a8a1-3e7f90f4c81c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.490588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.491243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.491526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.491804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.492579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.494501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.590457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1096/2160] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:03 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:03.594557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.604594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5cfd-b149-4498-8415-ec849842f674 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.667834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.668651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.671230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.671230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.671230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.673266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.748309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1065/2161] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:03 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:03.752658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.763827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c12e-3311-4a62-8977-0d7e72cad717 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.768633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.769309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.769795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.770440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.770908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.772547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.786338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1097/2162] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:03.792697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.818276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474174e1-c7e0-4f01-b056-cfe02a866c36 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.829262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5182ac-c26e-4a64-9b40-a3c07fbd80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.830007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5182ac-c26e-4a64-9b40-a3c07fbd80a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.830291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5182ac-c26e-4a64-9b40-a3c07fbd80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.830571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5182ac-c26e-4a64-9b40-a3c07fbd80a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.831467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5182ac-c26e-4a64-9b40-a3c07fbd80a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.833428 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5182ac-c26e-4a64-9b40-a3c07fbd80a5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.844453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1066/2163] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:03.848459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:03.859361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873983f-b419-4648-88fa-1b4f89f67917 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:03.863973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:03.865546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.865832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.866103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] PATH_INFO: `/v3/projects/401231fd8afe4cf09b7453f1691ade4e/users/63ad4052636443779bcd2c0823f59371/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:03.880739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401231fd8afe4cf09b7453f1691ade4e, user_id=63ad4052636443779bcd2c0823f59371, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.883462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.972396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1098/2164] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:03 2022] PUT /identity/v3/projects/401231fd8afe4cf09b7453f1691ade4e/users/63ad4052636443779bcd2c0823f59371/roles/246514336b4549609174329cae41663a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:03.982941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:03.983279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:03.983559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.010891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] MFA Rules not processed for user `63ad4052636443779bcd2c0823f59371`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:04.012096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:04.084973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1067/2165] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:04.089794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.159308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9435e1-98d3-434e-a6b7-1ef073fa28f9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.165090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.165948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.166565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.166858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.167521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.169502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.283537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1099/2166] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:04 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:04.289147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.300295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc76b-f4fd-4802-888f-89957b1d799f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.355934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.356641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.358909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.358909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.358909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.359818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.426355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1068/2167] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:04 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:04.430373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.440418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84c7ac-65ff-404a-8aa7-746a39555cb5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.448271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.448977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.449256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.449525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.450249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.451836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.466905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1100/2168] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:04.468117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.478824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab97393-005a-49ac-aa56-f7429025a394 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.483887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.484726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.485141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.485927 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] PATH_INFO: `/v3/projects/0a637137182046c9b72451992127fb3c/users/a3f1aa2f6d134b76b4d9075b2d685345/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.500862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a637137182046c9b72451992127fb3c, user_id=a3f1aa2f6d134b76b4d9075b2d685345, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.503910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.565696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1069/2169] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:04 2022] PUT /identity/v3/projects/0a637137182046c9b72451992127fb3c/users/a3f1aa2f6d134b76b4d9075b2d685345/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:04.570198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.580223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787e94-ecc3-4c68-aaf5-d2af1aed9c30 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.639204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1922f-e174-49d2-9e18-4102db143df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.639946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1922f-e174-49d2-9e18-4102db143df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.640226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1922f-e174-49d2-9e18-4102db143df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.640535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1922f-e174-49d2-9e18-4102db143df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.641263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1922f-e174-49d2-9e18-4102db143df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.642870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1922f-e174-49d2-9e18-4102db143df5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.654455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1101/2170] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:04.658463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.669108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9a99-eb85-4919-aa61-50bd4c13e435 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.674121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.675131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.675420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.675691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] PATH_INFO: `/v3/projects/0a637137182046c9b72451992127fb3c/users/a3f1aa2f6d134b76b4d9075b2d685345/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.677783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a637137182046c9b72451992127fb3c, user_id=a3f1aa2f6d134b76b4d9075b2d685345, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.680616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.691688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1070/2171] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:04 2022] PUT /identity/v3/projects/0a637137182046c9b72451992127fb3c/users/a3f1aa2f6d134b76b4d9075b2d685345/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:04.703282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.703607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.704028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.736255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] MFA Rules not processed for user `a3f1aa2f6d134b76b4d9075b2d685345`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:04.737484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:04.811924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1102/2172] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:04.823082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:04.825146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:04.905594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af841-9f95-4d81-a39e-1a9db6886403 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:04.909593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:04.910312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:04.910693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:04.911283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:04.925611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:04.927069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:04.936690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1071/2173] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:05.190111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:05.191589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:05.205059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cab00c-d4a5-4af9-8853-15582a0c19a4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:05.209179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:05.210384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:05.210735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:05.211014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:05.275332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:05.276820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:05.293699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1103/2174] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:06.614037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:06.617123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:06.708207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ad157-c571-4774-b849-f36520bcc498 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:06.713295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:06.714272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:06.714566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:06.714837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] PATH_INFO: `/v3/users/35d4828335a543758d1413c0276657a6` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:06.720012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d4828335a543758d1413c0276657a6)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:06.720012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:06.906897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d4828335a543758d1413c0276657a6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:06.918067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d4828335a543758d1413c0276657a6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:06.926277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d4828335a543758d1413c0276657a6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:06.941521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d4828335a543758d1413c0276657a6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:06.942807 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-efba95d0-0b83-4760-8b1c-46cd1575d1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d4828335a543758d1413c0276657a6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:07.016647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1072/2175] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:06 2022] DELETE /identity/v3/users/35d4828335a543758d1413c0276657a6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:07.252277 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:07.266758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b65d8-e085-49e9-9798-1fe2561bc625 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:07.325976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:07.326821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:07.327129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:07.327398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] PATH_INFO: `/v3/projects/11d99a6bb8ad42a980e51a57fcec7315` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:07.328649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d99a6bb8ad42a980e51a57fcec7315)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:07.335366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:07.483536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d99a6bb8ad42a980e51a57fcec7315', 'request_id': 'req-7c3601bb-e413-4055-a8da-299e5b297b05'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:07.598593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d99a6bb8ad42a980e51a57fcec7315', 'request_id': 'req-7c3601bb-e413-4055-a8da-299e5b297b05'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:07.606350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d99a6bb8ad42a980e51a57fcec7315', 'request_id': 'req-7c3601bb-e413-4055-a8da-299e5b297b05'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:07.625003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] The token cache is being invalidate because project 11d99a6bb8ad42a980e51a57fcec7315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:07.625302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:07.626223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c3601bb-e413-4055-a8da-299e5b297b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:07.628676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1104/2176] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:07 2022] DELETE /identity/v3/projects/11d99a6bb8ad42a980e51a57fcec7315 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:07.634186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:07.634661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:07.634758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:07.652720 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:07.653961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:07.715561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1073/2177] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:07.723410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:07.723701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:07.724538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:07.745240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:07.747078 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:07.755322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1105/2178] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:07.759797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:07.769628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6ff39-e2a8-4c5a-8ee6-f5b195219195 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:07.778952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:07.780139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:07.780721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:07.781199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:07.782514 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:07.783037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:07.786258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:07.800342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1074/2179] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:07.808723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:07.818538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4efdd-c60f-4730-9a04-6467abf68f12 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:07.823534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:07.824196 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:07.824518 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:07.824794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:07.825484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:07.828046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:07.938678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1106/2180] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:07 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:07.943019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:07.953151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd75341-6ce7-4e17-8ee7-6797566ec95f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.011069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.011730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.012010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.012283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.012993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.014961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.131009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1075/2181] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:07 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:08.135448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.145741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb39e3-4b09-4dba-8938-846e119cb985 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.151784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.157449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.157449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.157449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.157449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.157449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.168989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1107/2182] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:08.172928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.184853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cb876-012d-40af-be6c-a55e5e65e6bd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.189898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc557fca-e175-402e-a122-e3ec51938b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.190698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557fca-e175-402e-a122-e3ec51938b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.191780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557fca-e175-402e-a122-e3ec51938b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.191780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557fca-e175-402e-a122-e3ec51938b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.192012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557fca-e175-402e-a122-e3ec51938b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.194237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557fca-e175-402e-a122-e3ec51938b59 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.204525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1076/2183] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:08.209367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.219410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e891c1-dd50-41af-90d8-25a1dc6e47cf admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.224210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.225161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.225445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.225774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] PATH_INFO: `/v3/projects/5e68e63ff2d24ac5b9dac77f5d3a2461/users/cc99e0cceb304777a841545d3ae782bf/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.241971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e68e63ff2d24ac5b9dac77f5d3a2461, user_id=cc99e0cceb304777a841545d3ae782bf, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.244976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.320407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1108/2184] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:08 2022] PUT /identity/v3/projects/5e68e63ff2d24ac5b9dac77f5d3a2461/users/cc99e0cceb304777a841545d3ae782bf/roles/246514336b4549609174329cae41663a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:08.331370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.331664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.331953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.358979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] MFA Rules not processed for user `cc99e0cceb304777a841545d3ae782bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:08.360159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:08.421598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1077/2185] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:08.426067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.484855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0aefb-3798-45d4-ab7a-28bdfbfb7193 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.489640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.490244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.490539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.490808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.491502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.493476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.645701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1109/2186] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:08 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:08.649661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.659850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd056-d272-4be9-b31e-ffc9b1d98a05 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.716469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.716469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.716469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.716469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.717115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.719033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.810856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1078/2187] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:08 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:08.815014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.853709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea65ec-03d1-440f-879c-8ac5b7988986 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.868886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.870166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.870654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.871278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.872458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.874351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.890564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1110/2188] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:08.894594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:08.906311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257142-caa8-4de0-bf53-c181d7597805 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:08.912570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:08.912570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:08.912570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:08.912844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] PATH_INFO: `/v3/projects/5c47c614a8e944958c76735135671e07/users/0730c662c6af4bfaa8fd4f2d88b78566/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:08.929030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c47c614a8e944958c76735135671e07, user_id=0730c662c6af4bfaa8fd4f2d88b78566, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:08.931832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:08.999363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1079/2189] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:08 2022] PUT /identity/v3/projects/5c47c614a8e944958c76735135671e07/users/0730c662c6af4bfaa8fd4f2d88b78566/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:09.003464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:09.016112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62ca1-2774-4de3-a85e-460a621fde77 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:09.091771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94662-e0ec-4d1d-8e8d-266c4e87cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:09.092551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94662-e0ec-4d1d-8e8d-266c4e87cd4d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:09.092844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94662-e0ec-4d1d-8e8d-266c4e87cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:09.093128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94662-e0ec-4d1d-8e8d-266c4e87cd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:09.093892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba94662-e0ec-4d1d-8e8d-266c4e87cd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:09.095707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba94662-e0ec-4d1d-8e8d-266c4e87cd4d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:09.105882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1111/2190] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:09.110223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:09.124263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ee31-78e7-4cd5-8bae-3e9058f2968a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:09.126953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:09.127915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:09.128255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:09.128645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] PATH_INFO: `/v3/projects/5c47c614a8e944958c76735135671e07/users/0730c662c6af4bfaa8fd4f2d88b78566/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:09.131197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c47c614a8e944958c76735135671e07, user_id=0730c662c6af4bfaa8fd4f2d88b78566, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:09.134197 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:09.149306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1080/2191] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:09 2022] PUT /identity/v3/projects/5c47c614a8e944958c76735135671e07/users/0730c662c6af4bfaa8fd4f2d88b78566/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:09.159457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:09.159800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:09.160164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:09.187890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] MFA Rules not processed for user `0730c662c6af4bfaa8fd4f2d88b78566`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:09.189211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:09.269125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1112/2192] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:09.279864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:09.281586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:09.352136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce76a7-667a-465c-8e41-85ebb422b9fe admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:09.356854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:09.357509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:09.357865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:09.358315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:09.369617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:09.371047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:09.382189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1081/2193] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:09.610064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:09.621150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd987bd-4bcb-4d1e-91a7-39c716698a55 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:09.624885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:09.625531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:09.634145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:09.634145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:09.685155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:09.688916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:09.695480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1113/2194] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:17.080907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:17.082270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:17.138530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a21f-2190-4eb0-b0ec-3768897fccd2 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:17.142259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:17.152060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:17.152060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:17.152060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:17.152060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:17.204864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:17.206419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d684ab1-091e-4086-a057-b03ddb65be82 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:17.215440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1082/2195] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:22.658579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:22.660082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:22.729104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58b9a0-93f8-44dc-8384-02f17a7483f7 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:22.734417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:22.735454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:22.735925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:22.736198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] PATH_INFO: `/v3/users/63ad4052636443779bcd2c0823f59371` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:22.737498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ad4052636443779bcd2c0823f59371)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:22.739548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:22.971331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ad4052636443779bcd2c0823f59371'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:22.977864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ad4052636443779bcd2c0823f59371'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:22.989913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ad4052636443779bcd2c0823f59371'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:23.083563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ad4052636443779bcd2c0823f59371'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:23.085176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ad4052636443779bcd2c0823f59371'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:23.098000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:23.098817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:23.099508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:23.100696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1114/2196] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:22 2022] DELETE /identity/v3/users/63ad4052636443779bcd2c0823f59371 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:23.126951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:23.128498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:23.238602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:23.241105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:23.247732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1083/2197] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:23.317904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb0e2-5305-4e40-82ed-4f27278eea0d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:23.321947 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:23.323284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:23.323284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:23.323284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:23.334016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:23.335810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:23.381890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1115/2198] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:23.892305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:23.893909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:23.911398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769c33-a3af-4271-a447-fe41aa5216d6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:23.917081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:23.918211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:23.918674 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:23.919187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] PATH_INFO: `/v3/projects/401231fd8afe4cf09b7453f1691ade4e` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:23.923486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=401231fd8afe4cf09b7453f1691ade4e)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:23.923486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:24.049609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401231fd8afe4cf09b7453f1691ade4e', 'request_id': 'req-db32ea52-9ce2-4786-8dba-75d491325008'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.055654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401231fd8afe4cf09b7453f1691ade4e', 'request_id': 'req-db32ea52-9ce2-4786-8dba-75d491325008'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.061435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401231fd8afe4cf09b7453f1691ade4e', 'request_id': 'req-db32ea52-9ce2-4786-8dba-75d491325008'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.139029 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] The token cache is being invalidate because project 401231fd8afe4cf09b7453f1691ade4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:24.140308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.141034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.142768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1084/2199] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:23 2022] DELETE /identity/v3/projects/401231fd8afe4cf09b7453f1691ade4e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:24.147570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:24.157158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db1a4e-86ec-46a9-9bd0-4fa4658b64fe service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:24.233997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:24.235205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:24.235492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:24.235769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] PATH_INFO: `/v3/users/a3f1aa2f6d134b76b4d9075b2d685345` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:24.237098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f1aa2f6d134b76b4d9075b2d685345)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:24.239164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:24.383546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f1aa2f6d134b76b4d9075b2d685345'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.390914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f1aa2f6d134b76b4d9075b2d685345'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.402271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f1aa2f6d134b76b4d9075b2d685345'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.478364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f1aa2f6d134b76b4d9075b2d685345'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.478995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f1aa2f6d134b76b4d9075b2d685345'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:24.485453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1116/2200] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:24 2022] DELETE /identity/v3/users/a3f1aa2f6d134b76b4d9075b2d685345 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:24.909655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:24.909655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:24.924361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ea52-9ce2-4786-8dba-75d491325008 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:24.983882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:24.984808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:24.985097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:24.985374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] PATH_INFO: `/v3/projects/0a637137182046c9b72451992127fb3c` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:24.986561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a637137182046c9b72451992127fb3c)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:24.988548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.090946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a637137182046c9b72451992127fb3c', 'request_id': 'req-26609a30-ad28-4b68-b895-973510495c99'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.097283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a637137182046c9b72451992127fb3c', 'request_id': 'req-26609a30-ad28-4b68-b895-973510495c99'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.103241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a637137182046c9b72451992127fb3c', 'request_id': 'req-26609a30-ad28-4b68-b895-973510495c99'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.181695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.183129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:25.192096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] The token cache is being invalidate because project 0a637137182046c9b72451992127fb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:25.197836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.197836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-26609a30-ad28-4b68-b895-973510495c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.197836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1085/2201] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:24 2022] DELETE /identity/v3/projects/0a637137182046c9b72451992127fb3c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:25.198131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b1a4-7281-4cf6-bda6-eb78d42da1f3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.201501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cbbb1-b2e7-41eb-a3b5-44c21266bc89 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.201715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cbbb1-b2e7-41eb-a3b5-44c21266bc89 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.201997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cbbb1-b2e7-41eb-a3b5-44c21266bc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.221236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-941cbbb1-b2e7-41eb-a3b5-44c21266bc89 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:25.222656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-941cbbb1-b2e7-41eb-a3b5-44c21266bc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:25.256838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.257840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.258127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.258410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] PATH_INFO: `/v3/users/cc99e0cceb304777a841545d3ae782bf` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.259878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc99e0cceb304777a841545d3ae782bf)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.261834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.281490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1086/2202] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:25.289909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.290201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.290532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.309332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:25.310580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:25.318572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1087/2203] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:25.322646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.331322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8f585-3e03-428b-8b40-51255bdac801 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.337783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.338548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.338835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.339149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.339935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:25.340237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.341843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.354523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1088/2204] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:36:25.359096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.369202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4c69c-d13d-4bea-8b0f-254f3ecfa2b5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.374154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.374817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.375077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.375345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.376060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.378042 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.445304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc99e0cceb304777a841545d3ae782bf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.452745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc99e0cceb304777a841545d3ae782bf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.464016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc99e0cceb304777a841545d3ae782bf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.479557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1089/2205] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:25 2022] POST /identity/v3/projects => generated 355 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:25.483474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.524091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc99e0cceb304777a841545d3ae782bf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.524728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-485a1f24-9d76-402e-92ec-8cd1654abc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc99e0cceb304777a841545d3ae782bf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:25.537786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1117/2206] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:25 2022] DELETE /identity/v3/users/cc99e0cceb304777a841545d3ae782bf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:25.539499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.539868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.540210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.548413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919617d3-cc09-4f58-9de1-dad3725710e1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.558880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:25.562826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:25.607804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.608646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.608993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.609390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.610291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.612289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.635999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1118/2207] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:25.642725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.650317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:25.702245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f2385-8b5a-49ac-963e-6415fb865c0b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.705914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.709785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.709785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.709785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.719268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.720740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.730599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1119/2208] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:25.784112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1090/2209] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:25 2022] POST /identity/v3/users => generated 278 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:25.785406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.787434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:25.799988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5fd8-cca8-4218-b261-3568cf756eaf service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.805247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.806025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.806416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.806818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.808446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.810600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.827488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1120/2210] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:25.829002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.840280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b105e-a8da-4eaa-ae64-a8dbde98cf32 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.844937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c4729-059d-428f-8a83-2360284ccee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.845593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c4729-059d-428f-8a83-2360284ccee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.847595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c4729-059d-428f-8a83-2360284ccee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.847595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c4729-059d-428f-8a83-2360284ccee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.847595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c4729-059d-428f-8a83-2360284ccee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.849078 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c4729-059d-428f-8a83-2360284ccee6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.858848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1091/2211] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:25.862953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:25.872859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9b7b-9256-4755-853f-f92701566555 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:25.877468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:25.878325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.878603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.882100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] PATH_INFO: `/v3/projects/e0fba2e16e4144c9ba0d82305a44cf40/users/bc9b3c667f54447aa5bdd53ab2328936/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:25.893266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fba2e16e4144c9ba0d82305a44cf40, user_id=bc9b3c667f54447aa5bdd53ab2328936, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:25.896448 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:25.981754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1121/2212] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:25 2022] PUT /identity/v3/projects/e0fba2e16e4144c9ba0d82305a44cf40/users/bc9b3c667f54447aa5bdd53ab2328936/roles/246514336b4549609174329cae41663a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:25.992088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:25.992493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:25.992799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.018932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] MFA Rules not processed for user `bc9b3c667f54447aa5bdd53ab2328936`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:26.020715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:26.083714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1092/2213] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:26.088266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.149754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a02e6-da3b-4728-bfd4-c3bbec6247f9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.154816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.155596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.155886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.156167 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.156938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.159225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.166744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.170260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:26.190460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a72047-2cae-42eb-9b85-844e5d94ff00 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.197048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.199299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.199566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.199853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] PATH_INFO: `/v3/projects/5e68e63ff2d24ac5b9dac77f5d3a2461` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.201101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e68e63ff2d24ac5b9dac77f5d3a2461)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.203049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.237007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1122/2214] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:26 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:26.238239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.300028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6b70c-b043-404c-8b1d-c373306494aa admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.304937 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.305763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.306118 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.306473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.307243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.309360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.333571 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e68e63ff2d24ac5b9dac77f5d3a2461', 'request_id': 'req-42884017-e55b-4b44-afbc-3bbbf022b02f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.339720 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e68e63ff2d24ac5b9dac77f5d3a2461', 'request_id': 'req-42884017-e55b-4b44-afbc-3bbbf022b02f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.345131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e68e63ff2d24ac5b9dac77f5d3a2461', 'request_id': 'req-42884017-e55b-4b44-afbc-3bbbf022b02f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.396700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1123/2215] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:26 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:26.397782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.408956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1980d-e745-4bc8-95dd-c621627c6edc admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.415265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] The token cache is being invalidate because project 5e68e63ff2d24ac5b9dac77f5d3a2461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:26.420553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.420553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.420553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1093/2216] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:26 2022] DELETE /identity/v3/projects/5e68e63ff2d24ac5b9dac77f5d3a2461 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:26.423148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.424519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:26.471855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.472554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.472834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.473109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.473880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.475500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.485760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1124/2217] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:26.488960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884017-e55b-4b44-afbc-3bbbf022b02f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.489923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.493631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.495127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.495299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:26.495413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.495714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] PATH_INFO: `/v3/users/0730c662c6af4bfaa8fd4f2d88b78566` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.496963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0730c662c6af4bfaa8fd4f2d88b78566)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.498994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.508300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13bbc1-ed5b-4fb1-8d0f-cf8b7be92845 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.514622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.515499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.515779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.516051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] PATH_INFO: `/v3/projects/511743d67c624a50a2f6aa3896147430/users/a28131f55ffb48db8986ff8c8c33bb60/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.535224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511743d67c624a50a2f6aa3896147430, user_id=a28131f55ffb48db8986ff8c8c33bb60, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.538050 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.632998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1125/2218] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:26 2022] PUT /identity/v3/projects/511743d67c624a50a2f6aa3896147430/users/a28131f55ffb48db8986ff8c8c33bb60/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:26.637002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.696987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f0871-41fc-4934-8349-bc91255e9d99 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.701688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.702351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.702672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.702955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.703689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.705374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.708586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0730c662c6af4bfaa8fd4f2d88b78566'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.709406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0730c662c6af4bfaa8fd4f2d88b78566'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.715512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1126/2219] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:26.719579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.720014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0730c662c6af4bfaa8fd4f2d88b78566'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.729469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab00b-fcd2-4f6b-8d48-a1641ed70a1a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.732702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0730c662c6af4bfaa8fd4f2d88b78566'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.733394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0730c662c6af4bfaa8fd4f2d88b78566'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:26.734551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cea334-611f-44dd-9539-f30614787b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.735349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cea334-611f-44dd-9539-f30614787b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.735530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cea334-611f-44dd-9539-f30614787b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.735807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cea334-611f-44dd-9539-f30614787b0d admin admin] PATH_INFO: `/v3/projects/511743d67c624a50a2f6aa3896147430/users/a28131f55ffb48db8986ff8c8c33bb60/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.737981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cea334-611f-44dd-9539-f30614787b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=511743d67c624a50a2f6aa3896147430, user_id=a28131f55ffb48db8986ff8c8c33bb60, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:26.741150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cea334-611f-44dd-9539-f30614787b0d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:26.751559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1127/2220] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:26 2022] PUT /identity/v3/projects/511743d67c624a50a2f6aa3896147430/users/a28131f55ffb48db8986ff8c8c33bb60/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:26.763767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.764057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.764335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:26.796452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] MFA Rules not processed for user `a28131f55ffb48db8986ff8c8c33bb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:26.800666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:26.828536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1094/2221] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:26 2022] DELETE /identity/v3/users/0730c662c6af4bfaa8fd4f2d88b78566 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:26.890282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1128/2222] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:26.901903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:26.903729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:26.977771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b384-7567-4fe4-9051-13d51b2a2c51 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:26.981420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:26.982060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:26.982341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:26.982610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.047272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:27.048837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:27.060067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1095/2223] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:27.245494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:27.301039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a11a8-1ca6-484b-aab4-436b85eed2ec None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:27.304760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:27.305414 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.305699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.305976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.307856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:27.368819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:27.370264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7d435-234f-4a56-841b-21f86b4321d5 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:27.380468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1129/2224] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:27 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:27.394041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:27.396016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:27.469909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea978c-bb4e-4672-9d4f-c5426f8df9a1 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:27.475837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:27.476958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.477469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.477818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] PATH_INFO: `/v3/projects/5c47c614a8e944958c76735135671e07` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.479233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c47c614a8e944958c76735135671e07)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:27.482733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:27.611085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c47c614a8e944958c76735135671e07', 'request_id': 'req-016dba09-42ba-41f0-a95b-99b65b82e973'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:27.618084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c47c614a8e944958c76735135671e07', 'request_id': 'req-016dba09-42ba-41f0-a95b-99b65b82e973'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:27.631618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c47c614a8e944958c76735135671e07', 'request_id': 'req-016dba09-42ba-41f0-a95b-99b65b82e973'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:27.803202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] The token cache is being invalidate because project 5c47c614a8e944958c76735135671e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:27.803451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:27.804121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-016dba09-42ba-41f0-a95b-99b65b82e973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:27.805653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1096/2225] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:27 2022] DELETE /identity/v3/projects/5c47c614a8e944958c76735135671e07 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:27.810575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.810868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.811174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.828933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:27.830119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:27.893135 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1130/2226] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:27.902591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.902884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.903157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.920904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:27.922087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:27.930071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1097/2227] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:27.934242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:27.944316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333be8-25b2-4f3c-9330-c8a624161319 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:27.948997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:27.949648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.949957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.950228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.950949 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:27.951254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:27.952910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:27.967229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1131/2228] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:27.971220 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:27.982406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f654bb-1111-495f-afda-7bf94b480c64 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:27.987393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:27.988213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:27.988992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:27.989344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:27.990297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:27.992227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.072520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1098/2229] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:27 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:28.078370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.086325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e93d7-7912-4509-a28a-7cb3a49d4748 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.149885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.150934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.152104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.152347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.153242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.155433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.261921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1132/2230] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:28 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:28.265992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.276248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab0b-8062-4c84-8cf9-037c70594d0a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.280994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.281764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.282141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.282516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.283447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.285183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.295515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1099/2231] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:28.305373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.315384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f630-cc61-419a-814d-38bb22c36dcd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.320628 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddf737-2c52-4e3f-b7c9-eca7f06fc4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.321303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf737-2c52-4e3f-b7c9-eca7f06fc4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.321579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf737-2c52-4e3f-b7c9-eca7f06fc4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.321851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf737-2c52-4e3f-b7c9-eca7f06fc4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.322599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddf737-2c52-4e3f-b7c9-eca7f06fc4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.324187 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddf737-2c52-4e3f-b7c9-eca7f06fc4b2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.333797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1133/2232] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:28.337968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.347617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b786-629c-47ce-b8d6-964d5adfe4a7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.352142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.353031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.353307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.353574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] PATH_INFO: `/v3/projects/e952f96f33f54aa5bdd15678402da751/users/5d6abb8d4129440dbce80a6687b06bb5/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.367743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e952f96f33f54aa5bdd15678402da751, user_id=5d6abb8d4129440dbce80a6687b06bb5, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.370460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.457082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1100/2233] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:28 2022] PUT /identity/v3/projects/e952f96f33f54aa5bdd15678402da751/users/5d6abb8d4129440dbce80a6687b06bb5/roles/246514336b4549609174329cae41663a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:28.467580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.467865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.468139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.495386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] MFA Rules not processed for user `5d6abb8d4129440dbce80a6687b06bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:28.496653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:28.558588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1134/2234] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:28.563087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.624889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8d454-4639-4fc9-b6d1-4a8717a8b5e6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.630052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.631844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.631844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.631844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.631844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.633627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.719992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.720713 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1101/2235] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:28 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:28.731868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa30d-26ec-421b-865c-f74f0742ad25 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.790856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.792066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.792598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.793097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.794346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.796504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.897256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1135/2236] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:28 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:28.901027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.914754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfefc-e822-4598-a207-78d2b0227eb6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.920159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.923178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.923178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.923178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.923178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.924174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:28.935400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1102/2237] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:28.939536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:28.949609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee944-fa46-4335-a3be-061f2bfe8a65 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:28.954470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:28.955372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:28.955652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:28.955925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] PATH_INFO: `/v3/projects/49c734e4b4e44accb640ec0ac5049e75/users/b4a174aa66c04e3abc56042fc0e532cc/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:28.971061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c734e4b4e44accb640ec0ac5049e75, user_id=b4a174aa66c04e3abc56042fc0e532cc, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:28.974526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:29.051596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1136/2238] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:28 2022] PUT /identity/v3/projects/49c734e4b4e44accb640ec0ac5049e75/users/b4a174aa66c04e3abc56042fc0e532cc/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:29.055568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:29.065223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795ba9-b087-4c7a-aa2a-716f95c249a3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:29.132797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1342da-909a-4d8a-ab5b-e69f4228b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:29.133541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1342da-909a-4d8a-ab5b-e69f4228b6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:29.134086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1342da-909a-4d8a-ab5b-e69f4228b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:29.134363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1342da-909a-4d8a-ab5b-e69f4228b6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:29.135097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1342da-909a-4d8a-ab5b-e69f4228b6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:29.136852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1342da-909a-4d8a-ab5b-e69f4228b6c3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:29.148870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1103/2239] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:29.153114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:29.165991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ef42-f392-41e9-96d6-a3f435b22ee5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:29.171341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:29.173470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:29.173470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:29.173470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] PATH_INFO: `/v3/projects/49c734e4b4e44accb640ec0ac5049e75/users/b4a174aa66c04e3abc56042fc0e532cc/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:29.185499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c734e4b4e44accb640ec0ac5049e75, user_id=b4a174aa66c04e3abc56042fc0e532cc, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:29.188864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:29.202552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1137/2240] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:29 2022] PUT /identity/v3/projects/49c734e4b4e44accb640ec0ac5049e75/users/b4a174aa66c04e3abc56042fc0e532cc/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:29.213267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:29.213556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:29.213931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:29.252772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] MFA Rules not processed for user `b4a174aa66c04e3abc56042fc0e532cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:29.254155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:29.327989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1104/2241] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:29.339032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:29.340908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:29.402175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982717aa-c091-4cb6-af50-8df2342def7e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:29.405906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f6406-e95a-4ebb-aac0-21a40b344b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:29.406558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6406-e95a-4ebb-aac0-21a40b344b23 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:29.406845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6406-e95a-4ebb-aac0-21a40b344b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:29.407124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6406-e95a-4ebb-aac0-21a40b344b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:29.416441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f6406-e95a-4ebb-aac0-21a40b344b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:29.418286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f6406-e95a-4ebb-aac0-21a40b344b23 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:29.428593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1138/2242] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:29.605959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:29.616233 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573bbb-a3d3-4e1f-b597-b7e485cd0324 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:29.620231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:29.620960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:29.621238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:29.621505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:29.677215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:29.678555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:29.687443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1105/2243] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:33.034295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:33.034776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:33.034869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:33.054094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:33.055283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:33.109418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1139/2244] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:33.153391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:33.154772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:33.226407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120374ea-630f-4c75-93e9-3eaea0301a86 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:33.231390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:33.232026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:33.232306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:33.232611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:33.246175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:33.246175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:33.252163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1106/2245] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:36:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:36:37.309765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:37.365104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:37.367433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:37.384457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5b1f2-6a9a-421b-b478-256475b0982b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:37.389923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:37.391058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:37.391505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:37.391960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] PATH_INFO: `/v3/users/5d6abb8d4129440dbce80a6687b06bb5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:37.393409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6abb8d4129440dbce80a6687b06bb5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:37.395573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:37.434229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2aceb-46cf-48b6-b90d-d623a336672d service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:37.439299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:37.440017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:37.440247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:37.440629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:37.442700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:37.513904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:37.515682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d964fbd-7f48-477c-afc6-3967e23aa9ff service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:37.526532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1107/2246] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:37.558655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6abb8d4129440dbce80a6687b06bb5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:37.567438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6abb8d4129440dbce80a6687b06bb5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:37.587663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6abb8d4129440dbce80a6687b06bb5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:37.649384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6abb8d4129440dbce80a6687b06bb5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:37.650383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6abb8d4129440dbce80a6687b06bb5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:37.664033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1140/2247] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:37 2022] DELETE /identity/v3/users/5d6abb8d4129440dbce80a6687b06bb5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:37.669014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:37.669308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:37.669610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:37.693874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:37.695097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:37.771328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1108/2248] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:37.781032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:37.784361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:37.853824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230c37-e965-4246-a12b-0db04484dd99 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:37.858285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:37.858957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:37.859243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:37.859521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:37.878547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:37.880292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:37.894370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1141/2249] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:38.439690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:38.442641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:38.465504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2fb90-1023-47e5-b0e3-a27f07dafcd3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:38.471535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:38.472548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:38.472951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:38.473324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] PATH_INFO: `/v3/projects/e952f96f33f54aa5bdd15678402da751` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:38.474906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e952f96f33f54aa5bdd15678402da751)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:38.476928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:38.610586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e952f96f33f54aa5bdd15678402da751', 'request_id': 'req-89a1b712-a51e-4a63-b7cd-6662426337d0'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:38.619787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e952f96f33f54aa5bdd15678402da751', 'request_id': 'req-89a1b712-a51e-4a63-b7cd-6662426337d0'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:38.628237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e952f96f33f54aa5bdd15678402da751', 'request_id': 'req-89a1b712-a51e-4a63-b7cd-6662426337d0'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:38.714034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] The token cache is being invalidate because project e952f96f33f54aa5bdd15678402da751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:38.714736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:38.715782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:38.721824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1109/2250] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:38 2022] DELETE /identity/v3/projects/e952f96f33f54aa5bdd15678402da751 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:38.722108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:38.734369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1033f7-d2a7-4f64-874f-ebe39a4a166c service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:38.812543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:38.814338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:38.814890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:38.815338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] PATH_INFO: `/v3/users/b4a174aa66c04e3abc56042fc0e532cc` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:38.817697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a174aa66c04e3abc56042fc0e532cc)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:38.820310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:39.111308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a174aa66c04e3abc56042fc0e532cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:39.128987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a174aa66c04e3abc56042fc0e532cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:39.188366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a174aa66c04e3abc56042fc0e532cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:39.261024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a174aa66c04e3abc56042fc0e532cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:39.261771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-695a1d3d-d488-4241-8599-a6af05c7e974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a174aa66c04e3abc56042fc0e532cc'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:39.272178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1142/2251] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:38 2022] DELETE /identity/v3/users/b4a174aa66c04e3abc56042fc0e532cc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:39.946706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:39.948288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:39.966396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1b712-a51e-4a63-b7cd-6662426337d0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:40.045123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:40.045981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:40.046263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:40.046533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] PATH_INFO: `/v3/projects/49c734e4b4e44accb640ec0ac5049e75` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:40.047744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c734e4b4e44accb640ec0ac5049e75)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:40.049687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:40.445089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c734e4b4e44accb640ec0ac5049e75', 'request_id': 'req-4eef7e91-b880-4fa2-b398-41aeda019afc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:40.452551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c734e4b4e44accb640ec0ac5049e75', 'request_id': 'req-4eef7e91-b880-4fa2-b398-41aeda019afc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:40.459858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c734e4b4e44accb640ec0ac5049e75', 'request_id': 'req-4eef7e91-b880-4fa2-b398-41aeda019afc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:40.556917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] The token cache is being invalidate because project 49c734e4b4e44accb640ec0ac5049e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:40.557540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:40.558448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-4eef7e91-b880-4fa2-b398-41aeda019afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:40.560668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1110/2252] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:39 2022] DELETE /identity/v3/projects/49c734e4b4e44accb640ec0ac5049e75 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:40.565171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:40.565700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:40.565800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:40.584181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:40.591809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:40.657950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1143/2253] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:40.666100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:40.666387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:40.666670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:40.714478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:40.717291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:40.741303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1111/2254] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:40.743433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:40.769120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2bd44-620a-4230-82cc-6071738a91aa None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:40.789771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:40.793356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:40.795560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:40.796009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:40.796976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:40.798944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:40.804789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:40.829802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1144/2255] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:40.834774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:40.846063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7cd9c-cccf-4a93-b68e-a4b4cdb28b2b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:40.868996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:40.869785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:40.870176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:40.871026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:40.871861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:40.874602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:41.001387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1112/2256] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:40 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:41.002322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:41.022076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3ac4-a2f8-4099-a8b9-181a0a80d0cf admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:41.118103 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:41.118786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:41.119067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:41.119342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:41.120494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:41.123115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:41.245083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1145/2257] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:41 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:41.249683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:41.276223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb822-4cb6-4507-854d-30f88da05146 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:41.288886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:41.290314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:41.293917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:41.293917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:41.293917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:41.293917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:41.308868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1113/2258] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:41.312833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:41.328152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0e523-e044-4126-84a0-7e984567b127 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:41.340233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f70b-8746-46ee-8d63-5bb6c40bf36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:41.341035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f70b-8746-46ee-8d63-5bb6c40bf36b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:41.341395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f70b-8746-46ee-8d63-5bb6c40bf36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:41.341751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f70b-8746-46ee-8d63-5bb6c40bf36b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:41.342561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f70b-8746-46ee-8d63-5bb6c40bf36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:41.344239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f70b-8746-46ee-8d63-5bb6c40bf36b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:41.369837 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1146/2259] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:41.372552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:41.385192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07519ed-016c-458c-a43f-34f1546d4e5c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:41.390284 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:41.391312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:41.391797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:41.392291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] PATH_INFO: `/v3/projects/640d9bec1bee43bd8d8107c20553f117/users/0b525b7955244c2aa1d0e3bfa6f67d29/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:41.427905 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640d9bec1bee43bd8d8107c20553f117, user_id=0b525b7955244c2aa1d0e3bfa6f67d29, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:41.431646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:41.504458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1114/2260] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:41 2022] PUT /identity/v3/projects/640d9bec1bee43bd8d8107c20553f117/users/0b525b7955244c2aa1d0e3bfa6f67d29/roles/246514336b4549609174329cae41663a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:41.515730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:41.516072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:41.516482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:41.579966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] MFA Rules not processed for user `0b525b7955244c2aa1d0e3bfa6f67d29`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:41.584807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:41.718516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1147/2261] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:41.723084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:41.806822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0a78-cabe-4f2e-a16d-29fd7eb03ce4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:41.813083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:41.813845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:41.814132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:41.814410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:41.815119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:41.817684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:41.915081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1115/2262] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:41 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:41.919594 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:41.931732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c292843-25b5-4996-ab69-ed47d50b22ae None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:42.022809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:42.023772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.024269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.024724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.025861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:42.028821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:42.152599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1148/2263] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:41 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:42.156916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:42.168370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c5844-e41e-4e06-9966-2179445fffb8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:42.174599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:42.175479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.177160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.177632 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.178376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:42.180145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:42.191426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1116/2264] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:42.198332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:42.208913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5580e-a7d3-4729-9e6a-4f6625aee642 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:42.214034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:42.214909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.215314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.215668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] PATH_INFO: `/v3/projects/36583980383d47b29f058d8bb696b8ee/users/e39af3bef8514decb2c8a9d2d3951f47/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.233987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36583980383d47b29f058d8bb696b8ee, user_id=e39af3bef8514decb2c8a9d2d3951f47, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:42.236749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:42.364916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1149/2265] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:42 2022] PUT /identity/v3/projects/36583980383d47b29f058d8bb696b8ee/users/e39af3bef8514decb2c8a9d2d3951f47/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:42.368844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:42.380133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ffe9d-34b2-4c41-b7e1-2ca6de4792ad admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:42.447535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720eb3f-2a8a-46d7-bb22-9a5bebd68e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:42.448329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720eb3f-2a8a-46d7-bb22-9a5bebd68e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.448725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720eb3f-2a8a-46d7-bb22-9a5bebd68e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.449203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720eb3f-2a8a-46d7-bb22-9a5bebd68e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.450158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720eb3f-2a8a-46d7-bb22-9a5bebd68e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:42.452000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720eb3f-2a8a-46d7-bb22-9a5bebd68e46 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:42.463301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1117/2266] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:42.467539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:42.487893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75b906-97fe-408e-a98d-da830fa77663 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:42.493656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:42.494822 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.495152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.495493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] PATH_INFO: `/v3/projects/36583980383d47b29f058d8bb696b8ee/users/e39af3bef8514decb2c8a9d2d3951f47/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.497757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36583980383d47b29f058d8bb696b8ee, user_id=e39af3bef8514decb2c8a9d2d3951f47, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:42.500677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:42.513941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1150/2267] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:42 2022] PUT /identity/v3/projects/36583980383d47b29f058d8bb696b8ee/users/e39af3bef8514decb2c8a9d2d3951f47/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:42.526423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.526744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.526996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.557398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] MFA Rules not processed for user `e39af3bef8514decb2c8a9d2d3951f47`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:42.558695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:42.636326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1118/2268] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:42.646434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:42.648387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:42.722842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ab10-9974-4377-b0be-c225b257476d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:42.727426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f44f9-e4a9-4987-9147-1832da42e91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:42.728731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f44f9-e4a9-4987-9147-1832da42e91b service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:42.729251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f44f9-e4a9-4987-9147-1832da42e91b service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:42.729631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f44f9-e4a9-4987-9147-1832da42e91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:42.747422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f44f9-e4a9-4987-9147-1832da42e91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:42.749072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f44f9-e4a9-4987-9147-1832da42e91b service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:42.776270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1151/2269] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:43.335309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:43.410988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061aced-db4a-4b84-a8fb-c2b376a070fc None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:43.416283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:43.417310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:43.417595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:43.418004 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] PATH_INFO: `/v3/users/0b525b7955244c2aa1d0e3bfa6f67d29` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:43.419340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b525b7955244c2aa1d0e3bfa6f67d29)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:43.421415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:44.321074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b525b7955244c2aa1d0e3bfa6f67d29'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:44.321760 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b525b7955244c2aa1d0e3bfa6f67d29'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:44.329871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b525b7955244c2aa1d0e3bfa6f67d29'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:44.344235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b525b7955244c2aa1d0e3bfa6f67d29'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:44.344997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b525b7955244c2aa1d0e3bfa6f67d29'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:44.426483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1119/2270] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:43 2022] DELETE /identity/v3/users/0b525b7955244c2aa1d0e3bfa6f67d29 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:44.431096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:44.431647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:44.431647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:44.452278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:44.453665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:44.535209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1152/2271] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:44.541813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:44.544646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:44.608779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6842-fe0e-4ae8-b17b-c1fd6313913f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:44.613656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:44.614427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:44.614898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:44.615366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:44.636946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:44.639525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:44.662724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1120/2272] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:45.189210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:45.190810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:45.204239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9ee81-5180-488f-9fd7-0b5fc301460c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:45.211231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:45.212389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:45.212858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:45.213441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] PATH_INFO: `/v3/projects/640d9bec1bee43bd8d8107c20553f117` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:45.214686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640d9bec1bee43bd8d8107c20553f117)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:45.216910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:45.340276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640d9bec1bee43bd8d8107c20553f117', 'request_id': 'req-041d79d4-c821-481d-98ad-893c00ed1af4'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.426488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640d9bec1bee43bd8d8107c20553f117', 'request_id': 'req-041d79d4-c821-481d-98ad-893c00ed1af4'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.433185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640d9bec1bee43bd8d8107c20553f117', 'request_id': 'req-041d79d4-c821-481d-98ad-893c00ed1af4'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.444122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] The token cache is being invalidate because project 640d9bec1bee43bd8d8107c20553f117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:45.444326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.445122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.446682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1153/2273] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:45 2022] DELETE /identity/v3/projects/640d9bec1bee43bd8d8107c20553f117 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:45.450717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:45.461385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe194e2-6215-4c2a-b962-93ed343beff4 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:45.517625 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:45.518519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:45.518799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:45.519097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] PATH_INFO: `/v3/users/e39af3bef8514decb2c8a9d2d3951f47` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:45.520851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39af3bef8514decb2c8a9d2d3951f47)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:45.524173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:45.742297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39af3bef8514decb2c8a9d2d3951f47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.742872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39af3bef8514decb2c8a9d2d3951f47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.749579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39af3bef8514decb2c8a9d2d3951f47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.761661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39af3bef8514decb2c8a9d2d3951f47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.762386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b2b52475-130e-4cd5-979f-b74da10d20b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39af3bef8514decb2c8a9d2d3951f47'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:45.854352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1121/2274] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:45 2022] DELETE /identity/v3/users/e39af3bef8514decb2c8a9d2d3951f47 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:46.256206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:46.256206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:46.267108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d79d4-c821-481d-98ad-893c00ed1af4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:46.352334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:46.353235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:46.353513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:46.353787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] PATH_INFO: `/v3/projects/36583980383d47b29f058d8bb696b8ee` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:46.355041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36583980383d47b29f058d8bb696b8ee)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:46.357073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:46.462773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36583980383d47b29f058d8bb696b8ee', 'request_id': 'req-cde69349-c5db-43ca-b8c4-efcdca349409'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:46.534615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36583980383d47b29f058d8bb696b8ee', 'request_id': 'req-cde69349-c5db-43ca-b8c4-efcdca349409'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:46.541230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36583980383d47b29f058d8bb696b8ee', 'request_id': 'req-cde69349-c5db-43ca-b8c4-efcdca349409'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:46.552331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] The token cache is being invalidate because project 36583980383d47b29f058d8bb696b8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:46.552682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:46.553332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cde69349-c5db-43ca-b8c4-efcdca349409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:46.554880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1154/2275] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:46 2022] DELETE /identity/v3/projects/36583980383d47b29f058d8bb696b8ee => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:46.559987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:46.560523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:46.560876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:46.580213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:46.581466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:46.645392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1122/2276] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:46.652906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:46.653262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:46.653564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:46.678646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:46.679870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:46.693102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1155/2277] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:46.697661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:46.708367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa55f55-ea7a-44ad-94c0-6c324d85b647 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:46.713974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:46.716405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:46.716405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:46.716405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:46.716405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:46.716405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:46.717923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:46.729658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1123/2278] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:46.734337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:46.744343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5aa0-2ffb-4fbf-a88e-7a9eac93d14c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:46.749487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:46.750904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:46.750904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:46.750904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:46.751464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:46.753418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:46.850430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1156/2279] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:46 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:46.854510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:46.864934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ccec7-fe40-4f5e-aefe-365f910d6aeb admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:46.920046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:46.920784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:46.921077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:46.921351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:46.922072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:46.923989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.010962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1124/2280] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:46 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:47.015216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.025384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d365b-3a05-45a8-a1de-1f611837c7a4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.030064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.030717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.031010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.031286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.032012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.033652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.043797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1157/2281] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:47.047801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.057987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3453d3-5b0d-44cf-9a00-1bc2e59da80f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.062702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aa6f2-1873-45fd-8821-26f6b918e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.063359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa6f2-1873-45fd-8821-26f6b918e856 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.063645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa6f2-1873-45fd-8821-26f6b918e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.063925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa6f2-1873-45fd-8821-26f6b918e856 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.064712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aa6f2-1873-45fd-8821-26f6b918e856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.066322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aa6f2-1873-45fd-8821-26f6b918e856 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.076715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1125/2282] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:47.080911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.090625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123000-4ae3-4edc-9d9b-da0590f6a093 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.095372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.096240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.096556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.096834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] PATH_INFO: `/v3/projects/4f2f31631cd84f1d8528aecb1ac3c528/users/2829e6187fb240229cc905f996fc29fe/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.110957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2f31631cd84f1d8528aecb1ac3c528, user_id=2829e6187fb240229cc905f996fc29fe, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.114184 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.186883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1158/2283] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:47 2022] PUT /identity/v3/projects/4f2f31631cd84f1d8528aecb1ac3c528/users/2829e6187fb240229cc905f996fc29fe/roles/246514336b4549609174329cae41663a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:47.197194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.197486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.197762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.224283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] MFA Rules not processed for user `2829e6187fb240229cc905f996fc29fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:47.226434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:47.287444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1126/2284] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:47.292083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.352110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd758-2190-46ac-9fcf-6c52f4e62973 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.356826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.357474 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.357758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.358041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.358760 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.360702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.462356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1159/2285] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:47 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:47.466315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.477955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8ccc-383c-4ed9-8625-a4f96bc87821 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.550286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.550963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.551298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.551566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.552262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.554304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.644108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1127/2286] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:47 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:47.648690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.659360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7362b-a601-4eec-9433-51d8031660ba admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.664850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.665498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.665815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.666098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.666860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.668446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.679133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1160/2287] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:47.683451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.693808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35720-00fd-4873-9e53-e15566a03075 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.698312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.699232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.699513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.702407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] PATH_INFO: `/v3/projects/bf147f8790c74cf89ea9aa8b2c6decd3/users/490de9e68027437ea45bafccf6232c90/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.715747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf147f8790c74cf89ea9aa8b2c6decd3, user_id=490de9e68027437ea45bafccf6232c90, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.718432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.809201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1128/2288] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:47 2022] PUT /identity/v3/projects/bf147f8790c74cf89ea9aa8b2c6decd3/users/490de9e68027437ea45bafccf6232c90/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:47.813400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.823200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405fc14-3a73-4c23-aa1b-05c45f69509a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.877292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0d0ff-a524-424e-8940-a6657b36348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.877953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0d0ff-a524-424e-8940-a6657b36348f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.878239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0d0ff-a524-424e-8940-a6657b36348f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.878516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0d0ff-a524-424e-8940-a6657b36348f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.879229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0d0ff-a524-424e-8940-a6657b36348f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.881363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0d0ff-a524-424e-8940-a6657b36348f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.891060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1161/2289] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:47.895695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:47.905725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968007aa-833c-4913-84e3-119057b24cc6 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:47.910544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:47.911424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.911691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.911994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] PATH_INFO: `/v3/projects/bf147f8790c74cf89ea9aa8b2c6decd3/users/490de9e68027437ea45bafccf6232c90/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.913975 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf147f8790c74cf89ea9aa8b2c6decd3, user_id=490de9e68027437ea45bafccf6232c90, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:47.916633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:47.926367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1129/2290] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:47 2022] PUT /identity/v3/projects/bf147f8790c74cf89ea9aa8b2c6decd3/users/490de9e68027437ea45bafccf6232c90/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:47.937083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:47.937375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:47.937655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:47.964079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] MFA Rules not processed for user `490de9e68027437ea45bafccf6232c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:47.965247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:48.029759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1162/2291] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:48.039137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:48.040873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:48.094553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f5ade-f43d-4a57-bb88-d2067cee9a4b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:48.098182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599fe5-3cc4-4548-bb8b-b47af1e0bb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:48.098801 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599fe5-3cc4-4548-bb8b-b47af1e0bb80 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:48.099084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599fe5-3cc4-4548-bb8b-b47af1e0bb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:48.099360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599fe5-3cc4-4548-bb8b-b47af1e0bb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:48.153922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599fe5-3cc4-4548-bb8b-b47af1e0bb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:48.155358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599fe5-3cc4-4548-bb8b-b47af1e0bb80 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:48.165737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1130/2292] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:48.986896 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:48.988289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:49.054847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a699-d580-4b84-9905-74fcfd54e14e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:49.059537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:49.060402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:49.060715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:49.060995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] PATH_INFO: `/v3/users/bc9b3c667f54447aa5bdd53ab2328936` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:49.062191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9b3c667f54447aa5bdd53ab2328936)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:49.065511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:49.274160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9b3c667f54447aa5bdd53ab2328936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:49.280698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9b3c667f54447aa5bdd53ab2328936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:49.292090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9b3c667f54447aa5bdd53ab2328936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:49.369250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9b3c667f54447aa5bdd53ab2328936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:49.373187 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9b3c667f54447aa5bdd53ab2328936'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:49.375918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1163/2293] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:48 2022] DELETE /identity/v3/users/bc9b3c667f54447aa5bdd53ab2328936 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:49.381289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:49.381798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:49.381894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:49.398448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:49.401906 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:49.453968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1131/2294] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:49.463361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:49.464784 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:49.520968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11edb-f97c-45fe-b3e9-94b4c31369d0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:49.524656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:49.525311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:49.525602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:49.525910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:49.537938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:49.537938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:49.547422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1164/2295] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:50.031977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:50.033719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:50.048799 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11d3c7-118a-4a0d-95ca-f441ea8c680b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:50.055130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:50.056018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:50.056303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:50.056628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] PATH_INFO: `/v3/projects/e0fba2e16e4144c9ba0d82305a44cf40` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:50.061227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fba2e16e4144c9ba0d82305a44cf40)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:50.064120 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:50.180970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fba2e16e4144c9ba0d82305a44cf40', 'request_id': 'req-73e45458-327f-4616-9b8d-bee1651a3ff2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.188577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fba2e16e4144c9ba0d82305a44cf40', 'request_id': 'req-73e45458-327f-4616-9b8d-bee1651a3ff2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.195611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fba2e16e4144c9ba0d82305a44cf40', 'request_id': 'req-73e45458-327f-4616-9b8d-bee1651a3ff2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.265665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] The token cache is being invalidate because project e0fba2e16e4144c9ba0d82305a44cf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:50.270513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.270513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.270513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1132/2296] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:50 2022] DELETE /identity/v3/projects/e0fba2e16e4144c9ba0d82305a44cf40 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:50.272678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:50.282341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3a3b0-1beb-434e-aa98-77a8488a5c05 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:50.338969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:50.339957 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:50.340238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:50.340550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] PATH_INFO: `/v3/users/a28131f55ffb48db8986ff8c8c33bb60` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:50.341778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28131f55ffb48db8986ff8c8c33bb60)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:50.343719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:50.536048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28131f55ffb48db8986ff8c8c33bb60'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.542880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28131f55ffb48db8986ff8c8c33bb60'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.554892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28131f55ffb48db8986ff8c8c33bb60'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.643848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28131f55ffb48db8986ff8c8c33bb60'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.644506 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28131f55ffb48db8986ff8c8c33bb60'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:50.651111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1165/2297] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:50 2022] DELETE /identity/v3/users/a28131f55ffb48db8986ff8c8c33bb60 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:51.029377 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.030789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.050790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e45458-327f-4616-9b8d-bee1651a3ff2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.121717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.122629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.122907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.123351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] PATH_INFO: `/v3/projects/511743d67c624a50a2f6aa3896147430` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.124757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=511743d67c624a50a2f6aa3896147430)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.126886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.146212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.147569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.162800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bcb6e-500b-49ab-9c73-73ca94e22cd3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.167443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.168298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.168619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.168916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] PATH_INFO: `/v3/users/2829e6187fb240229cc905f996fc29fe` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.170076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2829e6187fb240229cc905f996fc29fe)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.172052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.246437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511743d67c624a50a2f6aa3896147430', 'request_id': 'req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.252960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511743d67c624a50a2f6aa3896147430', 'request_id': 'req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.258744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511743d67c624a50a2f6aa3896147430', 'request_id': 'req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.340298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] The token cache is being invalidate because project 511743d67c624a50a2f6aa3896147430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:51.340695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.341355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-12e23b65-bfe3-4fd5-8808-c3b08eb164ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.346791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1133/2298] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:51 2022] DELETE /identity/v3/projects/511743d67c624a50a2f6aa3896147430 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:51.350891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f5dcf-c5f6-4e06-8311-7f873f80a94f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.351273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f5dcf-c5f6-4e06-8311-7f873f80a94f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.351617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f5dcf-c5f6-4e06-8311-7f873f80a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.370653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-429f5dcf-c5f6-4e06-8311-7f873f80a94f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:51.371872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-429f5dcf-c5f6-4e06-8311-7f873f80a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.402878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2829e6187fb240229cc905f996fc29fe'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.410219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2829e6187fb240229cc905f996fc29fe'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.426982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2829e6187fb240229cc905f996fc29fe'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.447036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1134/2299] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:51.448758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80343-e415-4de8-b0c3-502b6970187a None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.449047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80343-e415-4de8-b0c3-502b6970187a None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.449322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80343-e415-4de8-b0c3-502b6970187a None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.451081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1135/2300] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:36:51.452123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050040-fb97-40f5-a282-98f8bf9e7564 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.452472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050040-fb97-40f5-a282-98f8bf9e7564 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.452753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050040-fb97-40f5-a282-98f8bf9e7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.472135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d3050040-fb97-40f5-a282-98f8bf9e7564 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:51.474845 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d3050040-fb97-40f5-a282-98f8bf9e7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.483034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1136/2301] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:51.484688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814154e-5459-4925-ae69-2cdd2983e262 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.484984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814154e-5459-4925-ae69-2cdd2983e262 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.485266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814154e-5459-4925-ae69-2cdd2983e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.500568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2829e6187fb240229cc905f996fc29fe'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.503565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2829e6187fb240229cc905f996fc29fe'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:51.508232 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1166/2302] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:51 2022] DELETE /identity/v3/users/2829e6187fb240229cc905f996fc29fe => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:51.509423 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.510811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.534752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8814154e-5459-4925-ae69-2cdd2983e262 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:51.536636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8814154e-5459-4925-ae69-2cdd2983e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.581193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fbfc8-471b-4439-a0fe-6339a382c640 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.588242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.589051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.589354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.589623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.590418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:51.590791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.592382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.603555 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1137/2303] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:51.605076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.605359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.605637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.613297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1167/2304] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:51.614689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.625249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:51.626259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51932a-850c-4c26-9c28-d822e5a6995f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.626442 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.632260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.632951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.633237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.633515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.634471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.636383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.638484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1138/2305] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:51.639305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.641073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.702535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab3291-b5e4-4c3f-aadf-addbf4cb9fb5 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.706312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.706957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.707312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.708109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.718633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.720045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.734308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1139/2306] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:51.735119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.736496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.794339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e43e-1fd7-437a-838b-648ac816a9b3 service glance] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.798006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059deb8-23cb-465d-81ec-5eab3a0ba7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.798638 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059deb8-23cb-465d-81ec-5eab3a0ba7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.798918 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059deb8-23cb-465d-81ec-5eab3a0ba7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.799190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059deb8-23cb-465d-81ec-5eab3a0ba7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.802521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1168/2307] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:51.803556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:51.809054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059deb8-23cb-465d-81ec-5eab3a0ba7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.810522 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059deb8-23cb-465d-81ec-5eab3a0ba7d9 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.820539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1140/2308] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:51.865032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bda73-45d3-403e-9360-9c81c00be7e1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:51.869950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:51.870609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.870887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.871157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.871841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:51.873799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:51.942330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c616-4405-47e7-9e5b-89b51409ccb1 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.942620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c616-4405-47e7-9e5b-89b51409ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.942926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c616-4405-47e7-9e5b-89b51409ccb1 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.944772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1141/2309] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:36:51.949170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:51.949457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:51.949737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:51.968150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:51.969427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:51.997662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1169/2310] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:52.001795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.012059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9424dd-3b08-4378-9661-825b38797223 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.016709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.017355 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.017636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.017913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.018626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.020257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.020378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1142/2311] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:52.030727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1170/2312] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:52.033050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.034340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.034881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:52.044012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cc881-559e-4e42-87db-4bf286ef16e8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.048466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371683a9-87a4-422f-ae7d-0b17ab565a74 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.048793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.049452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.049731 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.050006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.050726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.052854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.054101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7fa32-220f-410b-b669-d7f70bd32ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.054748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7fa32-220f-410b-b669-d7f70bd32ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.055430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7fa32-220f-410b-b669-d7f70bd32ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.055430 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7fa32-220f-410b-b669-d7f70bd32ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.064105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7fa32-220f-410b-b669-d7f70bd32ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.065683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7fa32-220f-410b-b669-d7f70bd32ec2 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.067629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1171/2313] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:52.068810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.079772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1143/2314] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:52.080321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662e7c4-9955-4b6c-a3b9-34842ea19da1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.085643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41065273-6270-478a-b0dd-a9582856a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.086017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065273-6270-478a-b0dd-a9582856a1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.086315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065273-6270-478a-b0dd-a9582856a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.086567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065273-6270-478a-b0dd-a9582856a1f8 admin admin] PATH_INFO: `/v3/projects/f0bab7376bfd47e0ba818b01246a5da1/users/cd424406326c45c7ae6c415a577efe79/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.105796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065273-6270-478a-b0dd-a9582856a1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bab7376bfd47e0ba818b01246a5da1, user_id=cd424406326c45c7ae6c415a577efe79, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.109255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065273-6270-478a-b0dd-a9582856a1f8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.173643 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1172/2315] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:52 2022] PUT /identity/v3/projects/f0bab7376bfd47e0ba818b01246a5da1/users/cd424406326c45c7ae6c415a577efe79/roles/246514336b4549609174329cae41663a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:52.175357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.175576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.175853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.205387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] MFA Rules not processed for user `cd424406326c45c7ae6c415a577efe79`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:52.206855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:52.215248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa44b-5f2f-4bb0-949a-5bf8807d0d7e None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.215540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa44b-5f2f-4bb0-949a-5bf8807d0d7e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.215818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa44b-5f2f-4bb0-949a-5bf8807d0d7e None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.217745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1173/2316] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:36:52.223335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.223646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.223923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.246492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:52.247894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:52.281169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1144/2317] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:52.285691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.318657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1174/2318] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:52.320533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.321936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:52.353240 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c53d08-fa3d-4dd2-b6ae-c4d188de2e7b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.358194 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.358955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.359245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.359523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.360215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.362171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.394436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ac280-caaf-48b9-943e-d09d44507af5 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.399032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.399875 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.400154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.400445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] PATH_INFO: `/v3/projects/4f2f31631cd84f1d8528aecb1ac3c528` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.401633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2f31631cd84f1d8528aecb1ac3c528)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.403599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.456405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1145/2319] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:52 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:52.457289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.496786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2f31631cd84f1d8528aecb1ac3c528', 'request_id': 'req-8ec93325-ae30-401c-96a6-54966f8b87e6'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.522785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c19db-5957-43e5-8464-7bb4a4488fbc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.563067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2f31631cd84f1d8528aecb1ac3c528', 'request_id': 'req-8ec93325-ae30-401c-96a6-54966f8b87e6'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.570093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2f31631cd84f1d8528aecb1ac3c528', 'request_id': 'req-8ec93325-ae30-401c-96a6-54966f8b87e6'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.570988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.571644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.571928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.572207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.582130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] The token cache is being invalidate because project 4f2f31631cd84f1d8528aecb1ac3c528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:52.591989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.591989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.591989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1175/2320] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:52 2022] DELETE /identity/v3/projects/4f2f31631cd84f1d8528aecb1ac3c528 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:52.591989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.591989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:52.655810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.657461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.658617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec93325-ae30-401c-96a6-54966f8b87e6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.663963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.664656 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.664945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.665225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.665909 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.668372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.670415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1146/2321] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:52.683054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.693394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf582f67-8bf0-44d0-9f70-8c2eed793e37 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.697995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.698940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.699205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.699483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] PATH_INFO: `/v3/users/490de9e68027437ea45bafccf6232c90` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.700725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=490de9e68027437ea45bafccf6232c90)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.702732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.741685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1176/2322] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:52 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:52.745462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.754954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7616-68f0-42fe-8868-97e05905a741 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.760049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.760725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.765917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.765917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.765917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.765917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.774143 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1177/2323] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:52.777865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.787806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a26603-38fb-4fb3-b32d-09bcce063bc9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.792468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.794210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.794210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.794210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.794642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.795873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.805770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1178/2324] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:52.809679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:52.819945 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549889-2712-4248-93b7-39d95639c10b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:52.824854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f29930-12e7-4c9e-83d3-8b02cfe23feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:52.825715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29930-12e7-4c9e-83d3-8b02cfe23feb admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.825997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29930-12e7-4c9e-83d3-8b02cfe23feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.826271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29930-12e7-4c9e-83d3-8b02cfe23feb admin admin] PATH_INFO: `/v3/projects/6dbbdb24f17b4afea898b156e0264c3b/users/fe908436e4e24ac1b9808c632e88187e/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.841431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f29930-12e7-4c9e-83d3-8b02cfe23feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbbdb24f17b4afea898b156e0264c3b, user_id=fe908436e4e24ac1b9808c632e88187e, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:52.844079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f29930-12e7-4c9e-83d3-8b02cfe23feb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:52.879849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490de9e68027437ea45bafccf6232c90'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.880523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490de9e68027437ea45bafccf6232c90'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.887509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490de9e68027437ea45bafccf6232c90'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.899069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490de9e68027437ea45bafccf6232c90'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.899717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490de9e68027437ea45bafccf6232c90'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:52.946365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1179/2325] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:52 2022] PUT /identity/v3/projects/6dbbdb24f17b4afea898b156e0264c3b/users/fe908436e4e24ac1b9808c632e88187e/roles/246514336b4549609174329cae41663a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:52.956387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:52.956709 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:52.956993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:52.969691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1147/2326] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:52 2022] DELETE /identity/v3/users/490de9e68027437ea45bafccf6232c90 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:52.985689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] MFA Rules not processed for user `fe908436e4e24ac1b9808c632e88187e`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:52.986889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.050182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1180/2327] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:53.055243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.056740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.122228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dbe30-d302-412f-b856-03ef310686fa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.126916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.127569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.127852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.128135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.128882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.131409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.243397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1148/2328] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:53 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:53.244824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.257262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679a3b-75a0-493f-b2f6-237f0da84e53 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.316794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.317465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.317753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.318034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.318767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.320743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.368737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.368737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.382166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d016e7-1c4a-4424-9b6d-1256fbc81faf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.393412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088524-996c-486e-8047-8f904a86399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.394592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088524-996c-486e-8047-8f904a86399f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.398779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088524-996c-486e-8047-8f904a86399f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.398779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088524-996c-486e-8047-8f904a86399f admin admin] PATH_INFO: `/v3/projects/bf147f8790c74cf89ea9aa8b2c6decd3` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.398779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088524-996c-486e-8047-8f904a86399f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf147f8790c74cf89ea9aa8b2c6decd3)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.398779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088524-996c-486e-8047-8f904a86399f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.401453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1181/2329] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:53 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:36:53.405570 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.420120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859dc4f-9139-4713-9222-d50f77e377a4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.426813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.427515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.427800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.428147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.428939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.433186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.441085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1182/2330] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:53.445203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.454803 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac677-d129-47b0-8fcd-6d59e7a15ac5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.459848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.460739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.461029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.461308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] PATH_INFO: `/v3/projects/5dede6a5d1c54aefba16c0dbd57739ed/users/3d04bdedce4646b3bb38627a3586f1a7/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.476596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dede6a5d1c54aefba16c0dbd57739ed, user_id=3d04bdedce4646b3bb38627a3586f1a7, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.480521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.569898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1183/2331] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:53 2022] PUT /identity/v3/projects/5dede6a5d1c54aefba16c0dbd57739ed/users/3d04bdedce4646b3bb38627a3586f1a7/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:53.576942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-23088524-996c-486e-8047-8f904a86399f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf147f8790c74cf89ea9aa8b2c6decd3', 'request_id': 'req-23088524-996c-486e-8047-8f904a86399f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:53.577699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.585478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-23088524-996c-486e-8047-8f904a86399f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf147f8790c74cf89ea9aa8b2c6decd3', 'request_id': 'req-23088524-996c-486e-8047-8f904a86399f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:53.591183 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-23088524-996c-486e-8047-8f904a86399f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf147f8790c74cf89ea9aa8b2c6decd3', 'request_id': 'req-23088524-996c-486e-8047-8f904a86399f'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:53.638784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-23088524-996c-486e-8047-8f904a86399f admin admin] The token cache is being invalidate because project bf147f8790c74cf89ea9aa8b2c6decd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:36:53.639137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-23088524-996c-486e-8047-8f904a86399f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:53.640095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-23088524-996c-486e-8047-8f904a86399f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:53.645726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1149/2332] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:36:53 2022] DELETE /identity/v3/projects/bf147f8790c74cf89ea9aa8b2c6decd3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:36:53.647570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f667-9b74-4082-b507-a7e4141834cd None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.648054 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f667-9b74-4082-b507-a7e4141834cd None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.648498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f667-9b74-4082-b507-a7e4141834cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.649338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb426-34b5-4723-a075-d7203a159323 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.668294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b814f667-9b74-4082-b507-a7e4141834cd None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:53.669696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b814f667-9b74-4082-b507-a7e4141834cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.721249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.722015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.722456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.722744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.724098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.725790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.738193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1184/2333] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:36:53.739211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1150/2334] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:53.747252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.747883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.748393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.753549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.755707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.775235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e57f0-969d-483a-95ea-114a66931c9a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.777398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff655934-90e6-4709-a00f-3b56dcaae762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.778454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff655934-90e6-4709-a00f-3b56dcaae762 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.778741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff655934-90e6-4709-a00f-3b56dcaae762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.779182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff655934-90e6-4709-a00f-3b56dcaae762 admin admin] PATH_INFO: `/v3/projects/5dede6a5d1c54aefba16c0dbd57739ed/users/3d04bdedce4646b3bb38627a3586f1a7/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.781250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff655934-90e6-4709-a00f-3b56dcaae762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dede6a5d1c54aefba16c0dbd57739ed, user_id=3d04bdedce4646b3bb38627a3586f1a7, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.784715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff655934-90e6-4709-a00f-3b56dcaae762 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.787211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:53.788609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.798882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1151/2335] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:36:53.801708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1185/2336] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:53 2022] PUT /identity/v3/projects/5dede6a5d1c54aefba16c0dbd57739ed/users/3d04bdedce4646b3bb38627a3586f1a7/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:53.803355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.811684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.812035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.812328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0467b0-9292-409d-9ae3-dc89838785e8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.812741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.846878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] MFA Rules not processed for user `3d04bdedce4646b3bb38627a3586f1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:53.848718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.879612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.880616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.880968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.881328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.883121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:36:53.884206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.885948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.898397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1152/2337] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:36:53.902872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.913023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2fc3-9e00-4690-9030-3f71b1ea766d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.917732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.918369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.918651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.918932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:53.919671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:53.921587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:53.926408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1186/2338] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:53.935593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:53.937002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:53.990862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f98a1-03da-436d-9712-969b4a2ae5ee None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:53.994437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:53.995072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:53.995353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:53.995629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.005025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:54.005195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1153/2339] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:36:53 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:54.006539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:54.009372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:54.016606 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1187/2340] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:54.070021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09589-3cbd-4df4-b1b0-03a181e8e14c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:54.074915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:54.075582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:54.075862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:54.076170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.076890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:54.078945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:54.163952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1154/2341] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:36:54 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:36:54.168770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:54.179261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891ff42-bfe8-4909-b59b-99c26fa989a3 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:54.183913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:54.184706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:54.184997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:54.185283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.186004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:54.187603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:54.197990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1188/2342] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:54.201988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:54.212387 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70ba4-72b8-42d5-a317-18912eddffe5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:54.220271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4e0f4-9d11-4d28-b16c-dd86c07e4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:54.220271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e0f4-9d11-4d28-b16c-dd86c07e4a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:54.220271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e0f4-9d11-4d28-b16c-dd86c07e4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:54.220271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e0f4-9d11-4d28-b16c-dd86c07e4a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.220694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4e0f4-9d11-4d28-b16c-dd86c07e4a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:54.221026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4e0f4-9d11-4d28-b16c-dd86c07e4a1b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:54.235011 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1155/2343] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:36:54.240411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:54.250327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab781-c027-4c49-b041-62d4ba8d3d27 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:54.255631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:54.256530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:54.256811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:54.257082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] PATH_INFO: `/v3/projects/0aba396e0ef040e8afa6e76fb9f69cc4/users/06a83e5a35f545a2baffa48ff9a6b880/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.271834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aba396e0ef040e8afa6e76fb9f69cc4, user_id=06a83e5a35f545a2baffa48ff9a6b880, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:54.274828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:54.364350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1189/2344] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:36:54 2022] PUT /identity/v3/projects/0aba396e0ef040e8afa6e76fb9f69cc4/users/06a83e5a35f545a2baffa48ff9a6b880/roles/246514336b4549609174329cae41663a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:54.375695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:54.375987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:54.376269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.403130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] MFA Rules not processed for user `06a83e5a35f545a2baffa48ff9a6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:54.404321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:54.472282 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1156/2345] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:54.482585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:54.484383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:54.542244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d24ae-e610-4ab7-98bd-ef8bb610b03d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:54.545940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e6ce2-fdc0-44e8-9f40-094fc4939112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:54.546584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e6ce2-fdc0-44e8-9f40-094fc4939112 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:54.546871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e6ce2-fdc0-44e8-9f40-094fc4939112 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:54.547169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e6ce2-fdc0-44e8-9f40-094fc4939112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:54.555346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e6ce2-fdc0-44e8-9f40-094fc4939112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:54.556821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e6ce2-fdc0-44e8-9f40-094fc4939112 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:54.565417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1190/2346] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:36:55.083553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:55.093871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77e3a0-95ec-43f0-823c-e0a245be3adf None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:55.098581 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:55.099179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:55.099542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:55.099827 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:55.101744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:55.162287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:55.168515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:55.172998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1157/2347] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:56.767768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:56.768220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:56.768356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:56.785243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:56.786428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:56.841882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1191/2348] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:56.853813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:56.855193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:56.921668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43495ebf-bf41-4332-90fd-656783c53154 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:56.927309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef51d6-04a1-4d22-823a-6634801bdde3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:56.932088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef51d6-04a1-4d22-823a-6634801bdde3 service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:56.932088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef51d6-04a1-4d22-823a-6634801bdde3 service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:56.932088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef51d6-04a1-4d22-823a-6634801bdde3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:56.936187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef51d6-04a1-4d22-823a-6634801bdde3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:56.937798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef51d6-04a1-4d22-823a-6634801bdde3 service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:56.945686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1158/2349] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:36:59.484755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:59.549755 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac60d6e-7212-489d-8173-9b7d374a4f8d None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:59.555339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:59.556233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:59.557070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:59.557070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] PATH_INFO: `/v3/users/06a83e5a35f545a2baffa48ff9a6b880` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:59.558263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a83e5a35f545a2baffa48ff9a6b880)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:59.560189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:59.745562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a83e5a35f545a2baffa48ff9a6b880'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:59.755153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a83e5a35f545a2baffa48ff9a6b880'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:59.770787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a83e5a35f545a2baffa48ff9a6b880'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:59.838580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a83e5a35f545a2baffa48ff9a6b880'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:59.839657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a83e5a35f545a2baffa48ff9a6b880'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:36:59.846853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1192/2350] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:36:59 2022] DELETE /identity/v3/users/06a83e5a35f545a2baffa48ff9a6b880 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:36:59.851867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:59.852342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:59.852589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:59.873435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:36:59.874859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:59.934517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1159/2351] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:36:59.945186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:59.946772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:00.032714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fad77-71cc-4505-a90d-9081bacf0adf admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:00.037985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:00.039363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:00.039845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:00.040317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:00.053924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:00.055787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:00.066712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1193/2352] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:00.067525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:00.069238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:00.084911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee26cb-a1ec-44d0-87f2-d0ee551e91f0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:00.089316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:00.089967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:00.090253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:00.090532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:00.092336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:00.170069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:00.171563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a34d00-f52f-4c7a-ad4a-9a7efd7984ae service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:00.183482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1160/2353] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:00.519272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:00.521637 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:00.534437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b560-5d28-46cd-b733-619813ab2858 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:00.539846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:00.540728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:00.541012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:00.541287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] PATH_INFO: `/v3/projects/0aba396e0ef040e8afa6e76fb9f69cc4` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:00.542474 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aba396e0ef040e8afa6e76fb9f69cc4)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:00.544516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:00.679393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aba396e0ef040e8afa6e76fb9f69cc4', 'request_id': 'req-69d4ff8a-2b6e-4262-8766-0355448a4744'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:00.884591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aba396e0ef040e8afa6e76fb9f69cc4', 'request_id': 'req-69d4ff8a-2b6e-4262-8766-0355448a4744'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:00.884591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aba396e0ef040e8afa6e76fb9f69cc4', 'request_id': 'req-69d4ff8a-2b6e-4262-8766-0355448a4744'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:00.884591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] The token cache is being invalidate because project 0aba396e0ef040e8afa6e76fb9f69cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:00.884591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:00.885193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-69d4ff8a-2b6e-4262-8766-0355448a4744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:00.885193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1194/2354] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:00 2022] DELETE /identity/v3/projects/0aba396e0ef040e8afa6e76fb9f69cc4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:00.885402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:00.885402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:00.885402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:00.898842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:00.900859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:00.970742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1161/2355] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:00.979302 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:00.979750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:00.979868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.017074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:01.018318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:01.026714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1195/2356] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:01.031163 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.042731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855a425-115d-4a39-ac3e-e53916b30ddf None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.104553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.104553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.104553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.104553 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.105016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:01.105016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.105016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:01.105016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1162/2357] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:01.109913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.126865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24dd5c-f2e1-467b-ac17-0b0cceafc6e3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.132919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.133632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.134306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.134699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.135391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.137454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:01.309356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.311036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:01.372238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d6769-fbb2-4d1e-8f33-b6d59d5044b3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.376032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.376707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.376993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.377268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.379049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:01.450814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.452160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:01.463063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1163/2358] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:01.600246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1196/2359] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:01 2022] POST /identity/v3/projects => generated 385 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:01.606254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.623176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead3c5-e654-472c-822e-6209ca587a1a service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.747291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.748297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.748653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.748836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.749641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.751668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:01.872981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1164/2360] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:01 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:01.876990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.898548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f8251-f98e-4002-81df-77f81118413c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.903204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.903865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.904152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.904462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.905198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.907104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:01.918832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1197/2361] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:01.922969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.932854 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e7edd-51c8-4e26-b201-d70e91d6f024 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.937501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.938151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.938516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.938766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.939586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.941408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:01.955112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1165/2362] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:37:01.959450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:01.970106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77bfd8-2dff-49f9-8e3b-775dd69808eb admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:01.975892 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308c56-2095-4815-bae3-07c6f0bf2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:01.976834 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308c56-2095-4815-bae3-07c6f0bf2c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:01.977116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308c56-2095-4815-bae3-07c6f0bf2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:01.977396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308c56-2095-4815-bae3-07c6f0bf2c18 admin admin] PATH_INFO: `/v3/projects/b7a3119cc3f94314aa23ed7ad6e722e5/users/e08870b3b648455498755b4132ae6d26/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:01.993927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad308c56-2095-4815-bae3-07c6f0bf2c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a3119cc3f94314aa23ed7ad6e722e5, user_id=e08870b3b648455498755b4132ae6d26, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:01.996750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad308c56-2095-4815-bae3-07c6f0bf2c18 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:02.035146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:02.037556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:02.044360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1198/2363] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:01 2022] PUT /identity/v3/projects/b7a3119cc3f94314aa23ed7ad6e722e5/users/e08870b3b648455498755b4132ae6d26/roles/246514336b4549609174329cae41663a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:02.054646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:02.054938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:02.055225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:02.081176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] MFA Rules not processed for user `e08870b3b648455498755b4132ae6d26`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:02.082424 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:02.113210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ee3c6-5fa0-4d70-ae64-a5c762016303 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:02.187468 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:02.188117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:02.188400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:02.188708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:02.189229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1199/2364] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:02.194788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:02.199876 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:02.201245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:02.217515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949103-cf8f-40da-b8a7-c95b5d74685a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:02.221653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:02.222308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:02.222595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:02.222877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:02.232279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:02.233781 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:02.243581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1200/2365] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:02.263577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:02.265423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:02.281080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1166/2366] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:06.363340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:06.364866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:06.427505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0242-75fd-4782-9101-eb8b1aa955b5 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:06.432345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:06.433183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:06.433512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:06.433872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] PATH_INFO: `/v3/users/cd424406326c45c7ae6c415a577efe79` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:06.435283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd424406326c45c7ae6c415a577efe79)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:06.437076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:06.456741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:06.470653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ad84-0eac-48c1-a5e0-43f7860a0e75 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:06.476145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:06.479247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:06.479247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:06.479247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] PATH_INFO: `/v3/users/e08870b3b648455498755b4132ae6d26` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:06.479247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08870b3b648455498755b4132ae6d26)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:06.481032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:06.667960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd424406326c45c7ae6c415a577efe79'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.674624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd424406326c45c7ae6c415a577efe79'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.687088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd424406326c45c7ae6c415a577efe79'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.700627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08870b3b648455498755b4132ae6d26'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.701277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08870b3b648455498755b4132ae6d26'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.708203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08870b3b648455498755b4132ae6d26'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.721767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08870b3b648455498755b4132ae6d26'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.728142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f388a0ae-9c11-4297-8390-864267f9fff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08870b3b648455498755b4132ae6d26'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.740327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd424406326c45c7ae6c415a577efe79'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.742291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a56b795c-7bc3-413f-855e-0aae34e345b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd424406326c45c7ae6c415a577efe79'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:06.747654 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1201/2367] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:06 2022] DELETE /identity/v3/users/cd424406326c45c7ae6c415a577efe79 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:06.751998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:06.752304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:06.752612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:06.774173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:06.775972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:06.797295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1167/2368] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:06 2022] DELETE /identity/v3/users/e08870b3b648455498755b4132ae6d26 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:06.801848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:06.802708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:06.804659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:06.830184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:06.831399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:06.843946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1202/2369] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:06.854079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:06.855386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:06.889476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1168/2370] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:06.899063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:06.900776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:06.910872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ef6b-3d01-4c9a-81b0-969d01f296ec None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:06.962086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3aa3c-8be7-47dd-a9e4-73bf62750e5b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:06.965803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:06.966482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:06.966763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:06.967045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:06.975459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:06.976346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:06.976913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:06.977236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:06.977521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:06.978683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:06.987761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:06.989077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1169/2371] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:06.989885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:07.004025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1203/2372] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:07.494857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:07.494857 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:07.504121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:07.504650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e9034-f884-422c-af15-0d480e190916 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:07.506219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:07.509401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:07.510358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:07.510596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:07.510873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] PATH_INFO: `/v3/projects/b7a3119cc3f94314aa23ed7ad6e722e5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:07.512072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a3119cc3f94314aa23ed7ad6e722e5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:07.514063 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:07.561860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d805258-cf87-4ea1-a755-73af11d48686 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:07.561860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:07.561860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:07.561860 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:07.562746 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] PATH_INFO: `/v3/projects/f0bab7376bfd47e0ba818b01246a5da1` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:07.563323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bab7376bfd47e0ba818b01246a5da1)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:07.569918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:07.645803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a3119cc3f94314aa23ed7ad6e722e5', 'request_id': 'req-e5c23d5a-9f21-421c-9683-d32785017074'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.653773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a3119cc3f94314aa23ed7ad6e722e5', 'request_id': 'req-e5c23d5a-9f21-421c-9683-d32785017074'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.663509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a3119cc3f94314aa23ed7ad6e722e5', 'request_id': 'req-e5c23d5a-9f21-421c-9683-d32785017074'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.728841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bab7376bfd47e0ba818b01246a5da1', 'request_id': 'req-649e9db8-ddb4-427d-a258-4fc323ddfeea'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.831693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] The token cache is being invalidate because project b7a3119cc3f94314aa23ed7ad6e722e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:07.832069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.832821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e5c23d5a-9f21-421c-9683-d32785017074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.834868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1170/2373] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:07 2022] DELETE /identity/v3/projects/b7a3119cc3f94314aa23ed7ad6e722e5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:07.839687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb2d7e-792a-478c-98fe-4b62bbf57e89 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:07.839976 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb2d7e-792a-478c-98fe-4b62bbf57e89 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:07.840278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb2d7e-792a-478c-98fe-4b62bbf57e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:07.858797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-66fb2d7e-792a-478c-98fe-4b62bbf57e89 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:07.859979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-66fb2d7e-792a-478c-98fe-4b62bbf57e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:07.894311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bab7376bfd47e0ba818b01246a5da1', 'request_id': 'req-649e9db8-ddb4-427d-a258-4fc323ddfeea'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.901527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bab7376bfd47e0ba818b01246a5da1', 'request_id': 'req-649e9db8-ddb4-427d-a258-4fc323ddfeea'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.912365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] The token cache is being invalidate because project f0bab7376bfd47e0ba818b01246a5da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:07.912682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.913310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:07.914852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1204/2374] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:07 2022] DELETE /identity/v3/projects/f0bab7376bfd47e0ba818b01246a5da1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:07.918156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1171/2375] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:07.919396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:07.920738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:07.925168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:07.925614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:07.926069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:07.935710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e9db8-ddb4-427d-a258-4fc323ddfeea admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:07.941157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:07.942038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:07.942320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:07.942629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] PATH_INFO: `/v3/users/fe908436e4e24ac1b9808c632e88187e` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:07.943866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe908436e4e24ac1b9808c632e88187e)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:07.945867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:07.970107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:07.971648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:07.990107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1172/2376] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:07.992824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.002137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f081-5209-4604-95ba-f62263b2e0ea None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.006809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.007458 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.007744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.008021 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.008788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:08.009366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.010949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.022560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1173/2377] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:08.026868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.036009 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba56b9-4d04-4c51-9809-9c29d09632b4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.041215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.041824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.047369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.047369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.047369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.047369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.120274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1174/2378] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:08 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:37:08.124131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.148894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe908436e4e24ac1b9808c632e88187e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.155701 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe908436e4e24ac1b9808c632e88187e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.167356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe908436e4e24ac1b9808c632e88187e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.185374 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b80374-fd7f-4720-9d63-62029331bce3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.190291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.190873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.191157 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.191434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.192142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.194715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.260494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe908436e4e24ac1b9808c632e88187e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.261188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe908436e4e24ac1b9808c632e88187e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.268180 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1205/2379] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:07 2022] DELETE /identity/v3/users/fe908436e4e24ac1b9808c632e88187e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:08.295371 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1175/2380] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:08 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:37:08.299519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.309730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:08.365166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55349b-965a-456b-9429-5283c4590e8f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.373120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.374229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.374708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.375179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.376094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.378028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.392988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1206/2381] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:08.394212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.406212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff98ab-cfa8-4bc6-9a37-42a8dc950da3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.412250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a3b5-fa01-473b-8730-74ea2d951599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.413229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a3b5-fa01-473b-8730-74ea2d951599 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.413499 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a3b5-fa01-473b-8730-74ea2d951599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.413783 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a3b5-fa01-473b-8730-74ea2d951599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.414524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8a3b5-fa01-473b-8730-74ea2d951599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.416146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8a3b5-fa01-473b-8730-74ea2d951599 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.427228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1176/2382] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:37:08.431080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.441110 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819dff4-dcc8-4b80-968b-1fd764c2e488 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.446673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.447566 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.448034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.448324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] PATH_INFO: `/v3/projects/8d11363c53ea4a7f9dd5d5c2534da543/users/1423bdc05ab34a96830ed491a9a64444/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.464177 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d11363c53ea4a7f9dd5d5c2534da543, user_id=1423bdc05ab34a96830ed491a9a64444, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.467363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.512825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1207/2383] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:08 2022] PUT /identity/v3/projects/8d11363c53ea4a7f9dd5d5c2534da543/users/1423bdc05ab34a96830ed491a9a64444/roles/246514336b4549609174329cae41663a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:08.522822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.523380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.523380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.569037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] MFA Rules not processed for user `1423bdc05ab34a96830ed491a9a64444`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:08.570453 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:08.645184 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1177/2384] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:08.654829 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.656598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:08.678257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:08.685185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:08.763069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0d4a-bf7a-4296-9c53-a4bc246c831e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.776443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c8a2-f7fe-4b3e-9a22-1fd5c5790a0f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:08.782246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.782421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:08.783033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.783317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.783432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:08.783590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.783702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:08.783904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] PATH_INFO: `/v3/projects/6dbbdb24f17b4afea898b156e0264c3b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:08.785638 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbbdb24f17b4afea898b156e0264c3b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.788086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.793722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:08.795406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:08.829373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1208/2385] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:08.955780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbbdb24f17b4afea898b156e0264c3b', 'request_id': 'req-d8bad473-4b45-449c-a156-42566c230158'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.962595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbbdb24f17b4afea898b156e0264c3b', 'request_id': 'req-d8bad473-4b45-449c-a156-42566c230158'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:08.968311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbbdb24f17b4afea898b156e0264c3b', 'request_id': 'req-d8bad473-4b45-449c-a156-42566c230158'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.082405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] The token cache is being invalidate because project 6dbbdb24f17b4afea898b156e0264c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:09.085895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.085895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.085895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1178/2386] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:08 2022] DELETE /identity/v3/projects/6dbbdb24f17b4afea898b156e0264c3b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:09.089179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:09.100990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8b517-c884-449f-8b05-5a8cd20444a4 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:09.159203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:09.160100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:09.160383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:09.160667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] PATH_INFO: `/v3/users/3d04bdedce4646b3bb38627a3586f1a7` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:09.162367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d04bdedce4646b3bb38627a3586f1a7)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:09.164273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:09.376457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d04bdedce4646b3bb38627a3586f1a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.383163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d04bdedce4646b3bb38627a3586f1a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.395374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d04bdedce4646b3bb38627a3586f1a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.483104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d04bdedce4646b3bb38627a3586f1a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.483799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8e855e7f-35c3-4c3f-8788-42c08ed6b640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d04bdedce4646b3bb38627a3586f1a7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:09.490299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1209/2387] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:09 2022] DELETE /identity/v3/users/3d04bdedce4646b3bb38627a3586f1a7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:09.890622 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:09.892644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:09.909294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bad473-4b45-449c-a156-42566c230158 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:09.968532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:09.969463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:09.969931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:09.970215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] PATH_INFO: `/v3/projects/5dede6a5d1c54aefba16c0dbd57739ed` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:09.971383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dede6a5d1c54aefba16c0dbd57739ed)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:09.973316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.059950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dede6a5d1c54aefba16c0dbd57739ed', 'request_id': 'req-1120c96d-4f1a-49ee-be50-108f24e2a752'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:10.065972 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dede6a5d1c54aefba16c0dbd57739ed', 'request_id': 'req-1120c96d-4f1a-49ee-be50-108f24e2a752'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:10.071875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dede6a5d1c54aefba16c0dbd57739ed', 'request_id': 'req-1120c96d-4f1a-49ee-be50-108f24e2a752'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:10.151508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] The token cache is being invalidate because project 5dede6a5d1c54aefba16c0dbd57739ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:10.151726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:10.152339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1120c96d-4f1a-49ee-be50-108f24e2a752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:10.153909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1179/2388] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:09 2022] DELETE /identity/v3/projects/5dede6a5d1c54aefba16c0dbd57739ed => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:10.159742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.160234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.160331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.178473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:10.179651 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:10.237220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1210/2389] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:10.245595 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.245888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.246172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.264239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:10.265472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:10.274094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1180/2390] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:10.278011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.287971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592530e-2582-4e24-831f-76ea142b2d0f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.292456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.293108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.293386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.293658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.294391 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:10.294693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.296285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.307502 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1211/2391] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:10.311977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.321085 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f7e5-0ed7-424d-8deb-e9b73ff352c6 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.325684 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.326331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.326616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.326893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.327588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.329550 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.427243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1181/2392] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:10.431228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.441107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34230-8be7-49a7-bfdc-cf64ff847f13 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.497085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.497759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.498044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.498320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.499105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.501060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.587163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1212/2393] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:10 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:10.591252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.601228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836eed7-53f6-4140-958c-9d71a51bb3d5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.605795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.606451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.606796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.607072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.607791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.609372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.619479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1182/2394] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:10.623315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.633600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd905ca-27df-4246-9662-e79876d2c948 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.638409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efff389-b47a-446d-9908-de9697dc7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.639051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efff389-b47a-446d-9908-de9697dc7925 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.639329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efff389-b47a-446d-9908-de9697dc7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.639600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efff389-b47a-446d-9908-de9697dc7925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.640356 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efff389-b47a-446d-9908-de9697dc7925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.641963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efff389-b47a-446d-9908-de9697dc7925 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.652108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1213/2395] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:10.656239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.666118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a9bf8-7282-4783-a125-3ccd95d42144 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.670742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.671608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.671884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.672153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] PATH_INFO: `/v3/projects/c51cac35e5e04fe89f4ca58885b7d7b0/users/30ea4c4eca0e46568770a638b1d70a83/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.686726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51cac35e5e04fe89f4ca58885b7d7b0, user_id=30ea4c4eca0e46568770a638b1d70a83, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.689362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:10.763057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1183/2396] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:10 2022] PUT /identity/v3/projects/c51cac35e5e04fe89f4ca58885b7d7b0/users/30ea4c4eca0e46568770a638b1d70a83/roles/246514336b4549609174329cae41663a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:37:10.774763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.775054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.775335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.801561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] MFA Rules not processed for user `30ea4c4eca0e46568770a638b1d70a83`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:10.802761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:10.863275 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1214/2397] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:10.867784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:10.927994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281ec6d-d8ba-484d-93ca-cdc086f551a9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:10.932789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:10.933441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:10.933724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:10.934000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:10.934692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:10.936617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.038883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1184/2398] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:37:11.042986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:11.053608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fe1ca-0000-468a-96ca-903acbc5c65a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:11.108621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:11.109371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.109674 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.109939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.110685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:11.112812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.209652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1215/2399] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:11 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:11.213640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:11.223851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44475bbb-f5a6-4d2c-81b2-e85b768de93a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:11.228773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:11.229525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.229951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.230229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.230952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:11.232577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.243020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1185/2400] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:37:11.247266 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:11.263958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb413873-43cd-4238-bbef-4703d25fa641 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:11.268804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:11.269676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.269959 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.270237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] PATH_INFO: `/v3/projects/eb6ea14516e74c63b0700ddc356754d9/users/af525a33dd5641a4987bb8c5eca21425/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.285433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6ea14516e74c63b0700ddc356754d9, user_id=af525a33dd5641a4987bb8c5eca21425, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:11.288682 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.368147 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1216/2401] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:11 2022] PUT /identity/v3/projects/eb6ea14516e74c63b0700ddc356754d9/users/af525a33dd5641a4987bb8c5eca21425/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:11.372152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:11.382364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7a5e-0ba3-4af6-826f-342d31eddc9b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:11.435390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd98cc4-b4fc-44d7-a069-7a95e2b281c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:11.436048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98cc4-b4fc-44d7-a069-7a95e2b281c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.436334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98cc4-b4fc-44d7-a069-7a95e2b281c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.436644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98cc4-b4fc-44d7-a069-7a95e2b281c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.437363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd98cc4-b4fc-44d7-a069-7a95e2b281c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:11.438948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd98cc4-b4fc-44d7-a069-7a95e2b281c0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.448791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1186/2402] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:11.452825 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:11.463455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eface3-1721-4331-9510-bbe783562db8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:11.468286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:11.469186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.469490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.469761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] PATH_INFO: `/v3/projects/eb6ea14516e74c63b0700ddc356754d9/users/af525a33dd5641a4987bb8c5eca21425/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.471753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6ea14516e74c63b0700ddc356754d9, user_id=af525a33dd5641a4987bb8c5eca21425, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:11.474513 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.484552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1217/2403] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:11 2022] PUT /identity/v3/projects/eb6ea14516e74c63b0700ddc356754d9/users/af525a33dd5641a4987bb8c5eca21425/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:11.495840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7343389-7a87-4b88-b593-4f253fbc5972 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.496125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7343389-7a87-4b88-b593-4f253fbc5972 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.496398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7343389-7a87-4b88-b593-4f253fbc5972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.523227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f7343389-7a87-4b88-b593-4f253fbc5972 None None] MFA Rules not processed for user `af525a33dd5641a4987bb8c5eca21425`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:11.524487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f7343389-7a87-4b88-b593-4f253fbc5972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:11.589392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1187/2404] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:11.599151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:11.600907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:11.657998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8556a-c5af-4184-b9b8-4f258c5d0f12 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:11.661996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550712a-eb04-4c9d-985b-cdc4b1098aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:11.662644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550712a-eb04-4c9d-985b-cdc4b1098aad service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.662928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550712a-eb04-4c9d-985b-cdc4b1098aad service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.663206 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550712a-eb04-4c9d-985b-cdc4b1098aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.674786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b114a-7094-40f7-accb-ec351faaff43 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:11.675082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b114a-7094-40f7-accb-ec351faaff43 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:11.675362 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b114a-7094-40f7-accb-ec351faaff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:11.693311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-924b114a-7094-40f7-accb-ec351faaff43 None None] MFA Rules not processed for user `1423bdc05ab34a96830ed491a9a64444`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:11.694494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-924b114a-7094-40f7-accb-ec351faaff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:11.718754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550712a-eb04-4c9d-985b-cdc4b1098aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:11.720204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550712a-eb04-4c9d-985b-cdc4b1098aad service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:11.729254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1218/2405] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:11.746654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1188/2406] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:12.249772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc45fb-d55d-4887-8cac-ad968e3658a1 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:12.250208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc45fb-d55d-4887-8cac-ad968e3658a1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:12.250334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc45fb-d55d-4887-8cac-ad968e3658a1 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:12.252166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1219/2407] 10.222.0.90 () {54 vars in 960 bytes} [Mon Feb 21 01:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:37:12.257481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:12.260277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:12.260277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:12.277581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc45fb-d55d-4887-8cac-ad968e3658a1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:12.283715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6cfc45fb-d55d-4887-8cac-ad968e3658a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:12.302851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] MFA Rules not processed for user `3cfe1d2d99d34692a0706f569971bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:12.306866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:12.363476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc45fb-d55d-4887-8cac-ad968e3658a1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:12.370342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:12.371303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:12.372299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:12.373039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:12.376008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:12.377058 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1189/2408] 10.222.0.90 () {58 vars in 1057 bytes} [Mon Feb 21 01:37:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:12.388417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:12.394966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdd35b-f27f-411c-b52c-f7582e9de833 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:12.401271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:12.402114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:12.402397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:12.402718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:12.404654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:12.417667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:12.419278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:12.429171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1190/2409] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:12.437888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:12.439492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:12.453550 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1220/2410] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:20.129475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:20.138718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf749-bbdc-4236-8014-651094600f73 service placement] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:20.142241 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:20.142868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:20.143149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:20.143425 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:20.152201 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:20.153658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:20.163689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1191/2411] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:26.783602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:26.785224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:26.790363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:26.845405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131c68-b68a-4b29-9c78-a08322fea4ea service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:26.849752 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:26.850470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:26.850707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:26.851109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:26.853096 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:26.854773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0900-79d8-453f-a78f-a6f77425fcf1 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:26.859452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:26.860418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:26.860863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:26.861248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] PATH_INFO: `/v3/users/30ea4c4eca0e46568770a638b1d70a83` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:26.862558 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ea4c4eca0e46568770a638b1d70a83)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:26.865196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:26.866820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:26.868718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1fb89-5d58-42f8-bbb4-2eaf52a5daaa service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:26.877735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1221/2412] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:27.045258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ea4c4eca0e46568770a638b1d70a83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.046010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ea4c4eca0e46568770a638b1d70a83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.053712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ea4c4eca0e46568770a638b1d70a83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.065731 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ea4c4eca0e46568770a638b1d70a83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.066492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ea4c4eca0e46568770a638b1d70a83'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.122798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1192/2413] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:26 2022] DELETE /identity/v3/users/30ea4c4eca0e46568770a638b1d70a83 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:27.127413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:27.127761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:27.128014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:27.145454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:27.146793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:27.207011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1222/2414] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:27.216911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:27.218762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:27.279917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17a3d8-5483-40d9-bbfc-aaef0638a2c2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:27.283535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:27.284224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:27.284542 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:27.284810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:27.295191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:27.296809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:27.306560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1193/2415] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:27.679264 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:27.680713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:27.693923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef30f08-e760-4e1a-bb5b-07e1de0a9153 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:27.698673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:27.700499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:27.700499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:27.700499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] PATH_INFO: `/v3/projects/c51cac35e5e04fe89f4ca58885b7d7b0` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:27.701445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51cac35e5e04fe89f4ca58885b7d7b0)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:27.703407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:27.802877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51cac35e5e04fe89f4ca58885b7d7b0', 'request_id': 'req-1718d282-13e5-4479-9ad3-9f6d409ba0f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.842775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51cac35e5e04fe89f4ca58885b7d7b0', 'request_id': 'req-1718d282-13e5-4479-9ad3-9f6d409ba0f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.854738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51cac35e5e04fe89f4ca58885b7d7b0', 'request_id': 'req-1718d282-13e5-4479-9ad3-9f6d409ba0f1'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.865629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] The token cache is being invalidate because project c51cac35e5e04fe89f4ca58885b7d7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:27.865916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.866572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:27.868117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1223/2416] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:27 2022] DELETE /identity/v3/projects/c51cac35e5e04fe89f4ca58885b7d7b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:27.872039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:27.881373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5155b-0333-4b55-b50d-e463033cf097 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:27.935205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:27.936071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:27.936358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:27.936673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] PATH_INFO: `/v3/users/af525a33dd5641a4987bb8c5eca21425` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:27.937855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af525a33dd5641a4987bb8c5eca21425)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:27.939822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:28.066206 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af525a33dd5641a4987bb8c5eca21425'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.066815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af525a33dd5641a4987bb8c5eca21425'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.073871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af525a33dd5641a4987bb8c5eca21425'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.085525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af525a33dd5641a4987bb8c5eca21425'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.086160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-fe4481ac-2289-4694-811e-db5c8f545fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af525a33dd5641a4987bb8c5eca21425'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.156518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1194/2417] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:27 2022] DELETE /identity/v3/users/af525a33dd5641a4987bb8c5eca21425 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:28.569123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:28.569123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:28.582511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d282-13e5-4479-9ad3-9f6d409ba0f1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:28.659335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:28.660199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:28.660517 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:28.660800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] PATH_INFO: `/v3/projects/eb6ea14516e74c63b0700ddc356754d9` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:28.662045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6ea14516e74c63b0700ddc356754d9)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:28.663991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:28.750824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6ea14516e74c63b0700ddc356754d9', 'request_id': 'req-dfa896a5-46b6-4fdf-be44-292452a19784'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.796727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6ea14516e74c63b0700ddc356754d9', 'request_id': 'req-dfa896a5-46b6-4fdf-be44-292452a19784'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.804144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6ea14516e74c63b0700ddc356754d9', 'request_id': 'req-dfa896a5-46b6-4fdf-be44-292452a19784'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.814571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] The token cache is being invalidate because project eb6ea14516e74c63b0700ddc356754d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:28.814861 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.815507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-dfa896a5-46b6-4fdf-be44-292452a19784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:28.817134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1224/2418] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:28 2022] DELETE /identity/v3/projects/eb6ea14516e74c63b0700ddc356754d9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:28.823856 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:28.824144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:28.824520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:28.842451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:28.843572 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:28.899874 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1195/2419] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:28.908341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:28.908665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:28.909061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:28.927853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:28.929082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:28.936961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1225/2420] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:28.941082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:28.951079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5060884-3663-4ddb-9421-f01be3e349c5 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:28.955697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:28.956337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:28.956644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:28.956920 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:28.957639 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:28.957971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:28.959546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:28.970875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1196/2421] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:28.975207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:28.984393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811642b-ee6f-483e-ac4f-37e892ca48e9 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:28.989049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:28.990261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:28.990537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:28.990810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:28.991490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:28.993427 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:29.118915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1226/2422] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:37:29.123062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:29.133000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa0cb-f3fd-4c29-9380-fc25287b9f72 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:29.188207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:29.188886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:29.189169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:29.189444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:29.190137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:29.192039 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:29.277165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1197/2423] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:29 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:37:29.281492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:29.292163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4be03-d111-4224-b3c7-62738ebcd6cf admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:29.297087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:29.297753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:29.300217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:29.300217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:29.300217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:29.300699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:29.312061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1227/2424] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:29.316052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:29.326059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea7338-e638-45d7-be6f-0449ec82bb77 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:29.330690 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2a115-a681-4f76-8f51-af882a4404d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:29.331352 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a115-a681-4f76-8f51-af882a4404d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:29.331628 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a115-a681-4f76-8f51-af882a4404d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:29.331902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a115-a681-4f76-8f51-af882a4404d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:29.332656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2a115-a681-4f76-8f51-af882a4404d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:29.334340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2a115-a681-4f76-8f51-af882a4404d8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:29.344345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1198/2425] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:37:29.349183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:29.359024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc6e9-60a4-4d2a-9d83-c12ef859a1ed admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:29.363574 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:29.365133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:29.365415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:29.365696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] PATH_INFO: `/v3/projects/cfd36be8ee0f488382417c13d0278775/users/568bb576625740638e21360181620f44/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:29.380286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd36be8ee0f488382417c13d0278775, user_id=568bb576625740638e21360181620f44, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:29.383033 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:29.494009 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1228/2426] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:29 2022] PUT /identity/v3/projects/cfd36be8ee0f488382417c13d0278775/users/568bb576625740638e21360181620f44/roles/246514336b4549609174329cae41663a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:29.505168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332485d-fa5d-4c45-b9e5-ce22cb2342b6 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:29.505459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332485d-fa5d-4c45-b9e5-ce22cb2342b6 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:29.505739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332485d-fa5d-4c45-b9e5-ce22cb2342b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:29.532701 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b332485d-fa5d-4c45-b9e5-ce22cb2342b6 None None] MFA Rules not processed for user `568bb576625740638e21360181620f44`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:29.533917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b332485d-fa5d-4c45-b9e5-ce22cb2342b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:29.596056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1199/2427] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:29.606403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:29.608091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:29.668123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab458da-59b8-4b1c-a866-ed23d68ba8fd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:29.679018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:29.679676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:29.679956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:29.680227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:29.690348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:29.691806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:29.701024 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1229/2428] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:31.123234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:31.123699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:31.123796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:31.141334 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:31.142582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:31.202131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1200/2429] 10.222.0.90 () {58 vars in 967 bytes} [Mon Feb 21 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:31.215015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:31.216390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:31.282730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e018f32-3a3a-43d2-a58c-26cb181a0f48 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:31.288331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf976e5-2466-4c0e-883f-4cc92f88c194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:31.289007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf976e5-2466-4c0e-883f-4cc92f88c194 service swift] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:31.289291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf976e5-2466-4c0e-883f-4cc92f88c194 service swift] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:31.289571 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf976e5-2466-4c0e-883f-4cc92f88c194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:31.297458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf976e5-2466-4c0e-883f-4cc92f88c194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:31.299067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf976e5-2466-4c0e-883f-4cc92f88c194 service swift] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:31.306968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1230/2430] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:37:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:37:33.136716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:33.138422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:33.246286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3ee4-02b8-449d-8d91-6a69e7c4776c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:33.253470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:33.255682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:33.256141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:33.257007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:33.259774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:33.272619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:33.274219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:33.284493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1201/2431] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:35.195047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16bbc-8405-4f64-a351-feb7e71e0c48 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:35.195593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16bbc-8405-4f64-a351-feb7e71e0c48 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:35.195593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16bbc-8405-4f64-a351-feb7e71e0c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:35.213129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-71f16bbc-8405-4f64-a351-feb7e71e0c48 None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:35.214256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-71f16bbc-8405-4f64-a351-feb7e71e0c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:35.221331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1231/2432] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:35.243402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:35.254151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f097ee-2813-4fa1-9999-6c21543e3ea2 service nova] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:35.259150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41873-f778-46b1-aa27-91669655548c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:35.260036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41873-f778-46b1-aa27-91669655548c service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:35.260312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41873-f778-46b1-aa27-91669655548c service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:35.260618 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41873-f778-46b1-aa27-91669655548c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:35.268223 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41873-f778-46b1-aa27-91669655548c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:35.269810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41873-f778-46b1-aa27-91669655548c service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:35.277376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1202/2433] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:37:36.037858 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb07517-5a6c-46c7-8a0b-ed5ddf87a25b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:36.038145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb07517-5a6c-46c7-8a0b-ed5ddf87a25b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:36.038420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb07517-5a6c-46c7-8a0b-ed5ddf87a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:36.057214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cdb07517-5a6c-46c7-8a0b-ed5ddf87a25b None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:36.058406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cdb07517-5a6c-46c7-8a0b-ed5ddf87a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:36.065489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1232/2434] 10.222.0.90 () {58 vars in 967 bytes} [Mon Feb 21 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:36.077351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41873-f778-46b1-aa27-91669655548c service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:36.087277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41873-f778-46b1-aa27-91669655548c service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:36.092149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:36.092802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:36.093082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:36.093360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:36.101487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:36.103031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:36.110603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1203/2435] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:37:36.624886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b3b6-1b0a-40c1-9f0c-afb168a6acfc None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:36.625330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b3b6-1b0a-40c1-9f0c-afb168a6acfc None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:36.625428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06b3b6-1b0a-40c1-9f0c-afb168a6acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:36.643319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fb06b3b6-1b0a-40c1-9f0c-afb168a6acfc None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:36.644419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fb06b3b6-1b0a-40c1-9f0c-afb168a6acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:36.651436 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1233/2436] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:36.670161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:36.673879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a880c9-a340-40c5-9e48-7fdb7568958b service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:36.679598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:36.680261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:36.680611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:36.680885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:36.689210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:36.690860 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:36.698993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1204/2437] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:37:37.206488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:37.206779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:37.207063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:37.225248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:37.226417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:37.233569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1234/2438] 10.222.0.90 () {58 vars in 967 bytes} [Mon Feb 21 01:37:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:37.245505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:37.255510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8cbd5-9b20-4353-bbb7-ace38cdcb231 service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:37.260665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f52a-bb59-4bd2-8a03-8e46b1eadac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:37.261290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f52a-bb59-4bd2-8a03-8e46b1eadac8 service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:37.261574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f52a-bb59-4bd2-8a03-8e46b1eadac8 service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:37.261850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f52a-bb59-4bd2-8a03-8e46b1eadac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:37.269578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f52a-bb59-4bd2-8a03-8e46b1eadac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:37.271672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f52a-bb59-4bd2-8a03-8e46b1eadac8 service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:37.279435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1205/2439] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:37:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:37:39.900349 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:39.901788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:39.979699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb270b07-25ad-4e68-aca6-55b9fc70246c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:39.986276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:39.987156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:39.987440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:39.987751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] PATH_INFO: `/v3/users/1423bdc05ab34a96830ed491a9a64444` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:39.990619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1423bdc05ab34a96830ed491a9a64444)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:39.992658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:40.175754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1423bdc05ab34a96830ed491a9a64444'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.182588 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1423bdc05ab34a96830ed491a9a64444'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.194347 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1423bdc05ab34a96830ed491a9a64444'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.275977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1423bdc05ab34a96830ed491a9a64444'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.276618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1423bdc05ab34a96830ed491a9a64444'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.282598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1235/2440] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:39 2022] DELETE /identity/v3/users/1423bdc05ab34a96830ed491a9a64444 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:40.292286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:40.292803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:40.292903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:40.309692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:40.310894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:40.368926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1206/2441] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:40.378694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:40.380641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:40.436925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56062-ddf0-4a95-97c2-4935c4afba73 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:40.440591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:40.441243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:40.441531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:40.441807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:40.451678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:40.453164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:40.463199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1236/2442] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:40.672243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:40.673838 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:40.686539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4dab0-4a31-416a-a387-1ec2b9ea329f None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:40.691323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:40.692099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:40.692466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:40.693264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] PATH_INFO: `/v3/projects/8d11363c53ea4a7f9dd5d5c2534da543` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:40.694460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d11363c53ea4a7f9dd5d5c2534da543)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:40.696369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:40.790033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d11363c53ea4a7f9dd5d5c2534da543', 'request_id': 'req-1d40037f-efd1-489c-a509-0f20e1ed848b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.796393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d11363c53ea4a7f9dd5d5c2534da543', 'request_id': 'req-1d40037f-efd1-489c-a509-0f20e1ed848b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.802310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d11363c53ea4a7f9dd5d5c2534da543', 'request_id': 'req-1d40037f-efd1-489c-a509-0f20e1ed848b'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.870541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] The token cache is being invalidate because project 8d11363c53ea4a7f9dd5d5c2534da543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:40.870826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.871603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1d40037f-efd1-489c-a509-0f20e1ed848b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:40.873160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1207/2443] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:40 2022] DELETE /identity/v3/projects/8d11363c53ea4a7f9dd5d5c2534da543 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:42.028199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:42.029662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:42.042514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b4baa-c8b5-47bf-a574-1ad47e562700 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:42.096247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:42.097148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:42.097425 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:42.097695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] PATH_INFO: `/v3/users/568bb576625740638e21360181620f44` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:42.098890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568bb576625740638e21360181620f44)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:42.100849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:42.323936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568bb576625740638e21360181620f44'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:42.330383 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568bb576625740638e21360181620f44'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:42.341382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568bb576625740638e21360181620f44'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:42.419251 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568bb576625740638e21360181620f44'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:42.419900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568bb576625740638e21360181620f44'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:42.425905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1237/2444] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:37:42 2022] DELETE /identity/v3/users/568bb576625740638e21360181620f44 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:42.430934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:42.431408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:42.431524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:42.449343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:42.450519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:42.506901 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1208/2445] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:42.516776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:42.518229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:42.586453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be54e-976a-4383-8286-c40f574b09a0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:42.590867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e419a3-978e-4945-80b7-a4c2f0b3128d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:42.591507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e419a3-978e-4945-80b7-a4c2f0b3128d service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:42.591785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e419a3-978e-4945-80b7-a4c2f0b3128d service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:42.592055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e419a3-978e-4945-80b7-a4c2f0b3128d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:42.601464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e419a3-978e-4945-80b7-a4c2f0b3128d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:42.602885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e419a3-978e-4945-80b7-a4c2f0b3128d service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:42.612164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1238/2446] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:43.010227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.011649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:43.024263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303ebed-b2e4-4759-8abe-9bdd3cb6eec1 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.029180 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.030252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.030709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.030981 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] PATH_INFO: `/v3/projects/cfd36be8ee0f488382417c13d0278775` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.032692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd36be8ee0f488382417c13d0278775)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.034815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.138645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd36be8ee0f488382417c13d0278775', 'request_id': 'req-bdacbddc-1a5e-4a59-bfbf-7d955848cede'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:43.144478 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd36be8ee0f488382417c13d0278775', 'request_id': 'req-bdacbddc-1a5e-4a59-bfbf-7d955848cede'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:43.150213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd36be8ee0f488382417c13d0278775', 'request_id': 'req-bdacbddc-1a5e-4a59-bfbf-7d955848cede'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:43.213590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] The token cache is being invalidate because project cfd36be8ee0f488382417c13d0278775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:37:43.213873 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:43.214507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-bdacbddc-1a5e-4a59-bfbf-7d955848cede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:37:43.216022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1209/2447] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:37:43 2022] DELETE /identity/v3/projects/cfd36be8ee0f488382417c13d0278775 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:37:43.220932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.221438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.221543 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.239077 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:43.240334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:43.303750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1239/2448] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:43.311492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.311778 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.312060 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.330382 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:43.331559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:43.340224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1210/2449] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:37:43.344220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.353743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5bc9-0f43-4d42-bb4e-4082b1e20052 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.358343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.358985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.359267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.359537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.360257 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:37:43.360595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.362199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.373288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1240/2450] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:37:43.377220 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.386748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dfdf3-4dcf-4c22-9b3c-7707b9f5d319 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.391487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.392061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.392337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.392644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.393331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.395185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.477435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1211/2451] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:37:43 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:37:43.481569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.491425 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcb060-111c-44b9-bd5b-d66366aedc64 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.545696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.546366 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.546652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.546931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.547633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.549764 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.625269 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1241/2452] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:37:43 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:37:43.629275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.640494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36206a-0ba4-4a9f-9777-b7dc37688316 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.646111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.646761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.647041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.647315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.648040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.649668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.659794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1212/2453] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:43.663596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.673359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06719277-58cf-45b7-bced-013b5b07e296 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.678453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b479ee9-1297-4ef0-8fcf-ef06e072b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.679099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479ee9-1297-4ef0-8fcf-ef06e072b6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.679376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479ee9-1297-4ef0-8fcf-ef06e072b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.679650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479ee9-1297-4ef0-8fcf-ef06e072b6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.680364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b479ee9-1297-4ef0-8fcf-ef06e072b6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.681977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b479ee9-1297-4ef0-8fcf-ef06e072b6f6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.691676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1242/2454] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:37:43.696386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.706074 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba6f11-8eb9-45f7-8608-debbb68a7e0b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.710650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.711517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.711797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.712077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] PATH_INFO: `/v3/projects/793c2ba0fbed4a46917b4b36bb46171a/users/7b5027ec4233411d9e1e436fd94266b6/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.725987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=793c2ba0fbed4a46917b4b36bb46171a, user_id=7b5027ec4233411d9e1e436fd94266b6, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:43.728662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:43.830537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1213/2455] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:37:43 2022] PUT /identity/v3/projects/793c2ba0fbed4a46917b4b36bb46171a/users/7b5027ec4233411d9e1e436fd94266b6/roles/246514336b4549609174329cae41663a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:37:43.840723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.841040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.841319 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:43.867056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] MFA Rules not processed for user `7b5027ec4233411d9e1e436fd94266b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:37:43.868223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:43.929027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1243/2456] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:37:43.938686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:43.940441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:43.994580 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d0ca-9bb5-43d8-8c09-e91983ab8d7f admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:43.998192 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:43.998810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:43.999079 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:43.999347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:44.007205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:44.008634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:44.017224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1214/2457] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:50.230394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:50.231851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:50.302944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcbe31-5677-492b-be91-645bf83ca785 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:50.308343 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:50.309005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:50.309286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:50.309559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:50.311289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:50.365832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:50.367437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187e8bb-80a5-49c9-ae25-2baa25d55f45 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:50.376497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1244/2458] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:11.850892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:11.918238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577769a-a665-4d58-900f-ea33ef0f2bec service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:11.922862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:11.923775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:11.924049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:11.924317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] PATH_INFO: `/v3/users/7b5027ec4233411d9e1e436fd94266b6` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:11.925566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5027ec4233411d9e1e436fd94266b6)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:11.928087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.094929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5027ec4233411d9e1e436fd94266b6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.095537 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5027ec4233411d9e1e436fd94266b6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.102657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5027ec4233411d9e1e436fd94266b6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.114245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5027ec4233411d9e1e436fd94266b6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.114888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5027ec4233411d9e1e436fd94266b6'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:12.195867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1215/2459] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:38:11 2022] DELETE /identity/v3/users/7b5027ec4233411d9e1e436fd94266b6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:12.200392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.200926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.201043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.218560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:12.219738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.283843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1245/2460] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:12.294269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.295790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.354469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c08ba-893c-453b-b241-b779b1e0d09c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.358306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31697f15-f150-4e84-bf7d-ad0eb9a5643d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.359059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31697f15-f150-4e84-bf7d-ad0eb9a5643d service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.359407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31697f15-f150-4e84-bf7d-ad0eb9a5643d service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.359756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31697f15-f150-4e84-bf7d-ad0eb9a5643d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.370392 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31697f15-f150-4e84-bf7d-ad0eb9a5643d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.372708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31697f15-f150-4e84-bf7d-ad0eb9a5643d service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:12.385505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1216/2461] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:38:12.916999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:12.918556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:12.930818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496337-f8ea-4f77-927a-4586e81b0db0 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:12.935460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:12.936309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:12.936650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:12.936927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] PATH_INFO: `/v3/projects/793c2ba0fbed4a46917b4b36bb46171a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:12.938111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793c2ba0fbed4a46917b4b36bb46171a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:12.940032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.060603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793c2ba0fbed4a46917b4b36bb46171a', 'request_id': 'req-e8b2209d-c701-4dd8-b78c-8811fb038a54'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.138863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793c2ba0fbed4a46917b4b36bb46171a', 'request_id': 'req-e8b2209d-c701-4dd8-b78c-8811fb038a54'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.145512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793c2ba0fbed4a46917b4b36bb46171a', 'request_id': 'req-e8b2209d-c701-4dd8-b78c-8811fb038a54'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.156026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] The token cache is being invalidate because project 793c2ba0fbed4a46917b4b36bb46171a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:38:13.156318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.156996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-e8b2209d-c701-4dd8-b78c-8811fb038a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:38:13.158531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1246/2462] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:38:12 2022] DELETE /identity/v3/projects/793c2ba0fbed4a46917b4b36bb46171a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:13.163524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.164017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.164110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.182303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:13.186072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.246436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1217/2463] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:13.255695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.256201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.256324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.274631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:13.279612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.283671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1247/2464] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:13.288151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.298225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a506c5-eb26-489e-8cde-653c3b9a629d None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.303486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.304251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.304404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.304718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.305446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:38:13.305889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.307489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.319536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1218/2465] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:38:13.323995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.333274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a71c-ee8f-4be9-b585-4b1f0e0001c1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.337995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.338649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.338933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.339229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.339902 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.342064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.463492 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1248/2466] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:38:13.464723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.475160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039bfe-f8da-47c7-8218-dbc3d2457e89 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.543147 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.543908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.544259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.544640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.545395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.547414 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.633657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1219/2467] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:38:13.636996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.646724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7ba7-7865-4146-8795-dc64b37eeadf admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.651824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.652161 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.652573 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.652926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.653724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.655412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.666726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1249/2468] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:13.670804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.681605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d929d2-9af3-4a49-9f37-ed4bf433dc31 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.686913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468af751-b118-49b9-86bf-8df910102454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.687064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af751-b118-49b9-86bf-8df910102454 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.687255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af751-b118-49b9-86bf-8df910102454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.687535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af751-b118-49b9-86bf-8df910102454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.688257 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468af751-b118-49b9-86bf-8df910102454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.689875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468af751-b118-49b9-86bf-8df910102454 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.699866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1220/2469] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:38:13.704083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.714456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015055-9c94-4da9-8295-4a067314f28d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.719233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.720106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.720393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.720699 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] PATH_INFO: `/v3/projects/8392d6773b9c480a963e6266327030be/users/f01151cae7bd44ca9a154274c6ab5891/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.736134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8392d6773b9c480a963e6266327030be, user_id=f01151cae7bd44ca9a154274c6ab5891, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.739939 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:13.802101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1250/2470] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:38:13 2022] PUT /identity/v3/projects/8392d6773b9c480a963e6266327030be/users/f01151cae7bd44ca9a154274c6ab5891/roles/246514336b4549609174329cae41663a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:38:13.812609 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.812933 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.813237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.842532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] MFA Rules not processed for user `f01151cae7bd44ca9a154274c6ab5891`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:38:13.843750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.907867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1221/2471] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:38:13.918641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:38:13.920270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:38:13.976747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb7f82-f705-4f0d-8c59-e7b467568f77 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:38:13.980379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5ab6-efc0-4405-9862-51c032969dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:38:13.981158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5ab6-efc0-4405-9862-51c032969dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:38:13.981440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5ab6-efc0-4405-9862-51c032969dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:38:13.981714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5ab6-efc0-4405-9862-51c032969dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:38:13.989928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5ab6-efc0-4405-9862-51c032969dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:38:13.994907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5ab6-efc0-4405-9862-51c032969dc7 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:38:14.000282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1251/2472] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:38:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:02.606925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:02.676878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff995-23f0-43d1-be8f-f171353fc1a3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:02.681534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:02.682399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:02.682680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:02.682983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] PATH_INFO: `/v3/users/f01151cae7bd44ca9a154274c6ab5891` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:02.684271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01151cae7bd44ca9a154274c6ab5891)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:02.686228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:02.866544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01151cae7bd44ca9a154274c6ab5891'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.867577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01151cae7bd44ca9a154274c6ab5891'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.876607 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01151cae7bd44ca9a154274c6ab5891'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.898179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01151cae7bd44ca9a154274c6ab5891'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.899066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01151cae7bd44ca9a154274c6ab5891'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:02.995831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1222/2473] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:02 2022] DELETE /identity/v3/users/f01151cae7bd44ca9a154274c6ab5891 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:03.000578 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.004723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.004723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.021041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:03.022463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.081219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1252/2474] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:03.092331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.093952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.154697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9705-92c6-473d-bfe1-1b48f3fac6dd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.158290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d58558-1be3-499f-a9d8-deea11daf001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.158969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d58558-1be3-499f-a9d8-deea11daf001 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.159246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d58558-1be3-499f-a9d8-deea11daf001 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.159516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d58558-1be3-499f-a9d8-deea11daf001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.168276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d58558-1be3-499f-a9d8-deea11daf001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.169717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d58558-1be3-499f-a9d8-deea11daf001 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.179222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1223/2475] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:39:03.598404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:03.599852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.640907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cfd61-2804-4c98-9373-44f756a2be77 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:03.646976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:03.647960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.648299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.648657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] PATH_INFO: `/v3/projects/8392d6773b9c480a963e6266327030be` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.650593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8392d6773b9c480a963e6266327030be)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:03.652370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:03.748972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8392d6773b9c480a963e6266327030be', 'request_id': 'req-8cc4b000-e4b9-48b4-a763-9f37abf00603'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.800772 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8392d6773b9c480a963e6266327030be', 'request_id': 'req-8cc4b000-e4b9-48b4-a763-9f37abf00603'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.808743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8392d6773b9c480a963e6266327030be', 'request_id': 'req-8cc4b000-e4b9-48b4-a763-9f37abf00603'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.821560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] The token cache is being invalidate because project 8392d6773b9c480a963e6266327030be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:03.821560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.821560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-8cc4b000-e4b9-48b4-a763-9f37abf00603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:03.822876 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1253/2476] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:03 2022] DELETE /identity/v3/projects/8392d6773b9c480a963e6266327030be => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:03.827534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.828103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.828103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.845497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:03.850932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.906406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1224/2477] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:03.972233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:03.972233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:03.972233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:03.989965 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:03.991142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:03.999665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1254/2478] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:04.003863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.014623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c8587-445d-4d4b-b723-a813e73cd299 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.019270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.019914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.020196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.020505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.021307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:39:04.021619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.023276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.034503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1225/2479] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:39:04.038758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.047943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc12fa6-27ed-4984-9aed-3b6e9a468e4a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.052693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.053396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.053863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.054215 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.055041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.057608 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.175072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1255/2480] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:39:04 2022] POST /identity/v3/projects => generated 397 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:04.179082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.189800 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0593f-f14e-427c-ad4e-90b4efa054aa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.247823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.248535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.248813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.249088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.249780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.252095 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.350010 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1226/2481] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:39:04 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:39:04.354756 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.365368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5fa0-af87-449c-9865-46b9c2d492ce admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.370955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.371877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.372229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.372603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.373375 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.375029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.386226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1256/2482] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:39:04.390923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.402327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ae3e-07d3-499e-9fac-2c29165ee485 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.407385 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf4e70-a8f9-406a-a308-c3f94d844f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.408123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf4e70-a8f9-406a-a308-c3f94d844f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.408517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf4e70-a8f9-406a-a308-c3f94d844f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.408866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf4e70-a8f9-406a-a308-c3f94d844f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.409663 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf4e70-a8f9-406a-a308-c3f94d844f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.411337 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf4e70-a8f9-406a-a308-c3f94d844f23 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.422511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1227/2483] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:39:04.426733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.437254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273342-34a2-43c7-aa26-6f200460db6f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.441918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.443212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.443212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.443465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] PATH_INFO: `/v3/projects/4f001f207aa042cabeecbd5e67c61faa/users/e1c947e15a0e4b06a74c5ee46ab30214/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.457421 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f001f207aa042cabeecbd5e67c61faa, user_id=e1c947e15a0e4b06a74c5ee46ab30214, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.460066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.538530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1257/2484] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:39:04 2022] PUT /identity/v3/projects/4f001f207aa042cabeecbd5e67c61faa/users/e1c947e15a0e4b06a74c5ee46ab30214/roles/246514336b4549609174329cae41663a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:04.549616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf11fe6-de0f-48e6-b158-831901ca6362 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.549909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf11fe6-de0f-48e6-b158-831901ca6362 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.550191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf11fe6-de0f-48e6-b158-831901ca6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.577606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-eaf11fe6-de0f-48e6-b158-831901ca6362 None None] MFA Rules not processed for user `e1c947e15a0e4b06a74c5ee46ab30214`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:04.578809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-eaf11fe6-de0f-48e6-b158-831901ca6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.643872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1228/2485] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:04.654107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:04.656212 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:04.714908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1f00b-2463-4dba-a79a-d319d8ee1953 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:04.718616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:04.719261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:04.719551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:04.719832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:04.727975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:04.730111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:04.738765 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1258/2486] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:05.711551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:05.712008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:05.712140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:05.730350 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] MFA Rules not processed for user `ab38a084fbb643298d38c4cd8dcf87cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:05.735636 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:05.784711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1229/2487] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:06.226171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.227553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:06.281718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07af10-b4f6-463c-9299-52e876ad5abb service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.285326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.285962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.286244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.286519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.288248 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:06.297294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.298718 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ebb02-1fb7-436c-9611-62875800bc09 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.306916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1259/2488] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:15.699205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:15.758498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed172ca5-d913-407d-9a31-275966b91de3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:15.763867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:15.764746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:15.765025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:15.765292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] PATH_INFO: `/v3/users/e1c947e15a0e4b06a74c5ee46ab30214` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:15.766446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c947e15a0e4b06a74c5ee46ab30214)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:15.768342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:15.938719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c947e15a0e4b06a74c5ee46ab30214'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.939295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c947e15a0e4b06a74c5ee46ab30214'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.945712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c947e15a0e4b06a74c5ee46ab30214'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.957342 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c947e15a0e4b06a74c5ee46ab30214'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:15.957973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c947e15a0e4b06a74c5ee46ab30214'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:16.045818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1230/2489] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:15 2022] DELETE /identity/v3/users/e1c947e15a0e4b06a74c5ee46ab30214 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:16.050461 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.050951 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.051062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.068491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:16.069670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:16.126966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1260/2490] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:16.136669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.138040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:16.192108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c261-6a4b-485c-a4a6-5390584184d2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.195641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.196276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.196592 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.196871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.205434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.206835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.215757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1231/2491] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:39:16.606063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:16.607569 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:16.622089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ae74e-9bf5-4122-8c06-05f05b98dcc2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:16.626757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:16.627715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:16.627928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:16.628162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] PATH_INFO: `/v3/projects/4f001f207aa042cabeecbd5e67c61faa` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:16.629369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f001f207aa042cabeecbd5e67c61faa)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:16.631282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:16.731465 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f001f207aa042cabeecbd5e67c61faa', 'request_id': 'req-70938512-8a84-4f92-9c34-0fa0c3bfe118'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:16.805795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f001f207aa042cabeecbd5e67c61faa', 'request_id': 'req-70938512-8a84-4f92-9c34-0fa0c3bfe118'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:16.812614 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f001f207aa042cabeecbd5e67c61faa', 'request_id': 'req-70938512-8a84-4f92-9c34-0fa0c3bfe118'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:16.822741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] The token cache is being invalidate because project 4f001f207aa042cabeecbd5e67c61faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:16.823560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:16.824238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:16.825794 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1261/2492] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:16 2022] DELETE /identity/v3/projects/4f001f207aa042cabeecbd5e67c61faa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:20.899853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:20.901486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:20.971519 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f27c-a5a2-43a0-8bfb-761c52fdb859 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:21.041308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:21.042756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:21.052454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:21.053312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:21.054717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:21.068169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:21.071040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdd4a3-fe02-44f4-9ec0-5e8caf6b277c service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:21.083917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1232/2493] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:35.216705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:35.221318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:35.234534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938512-8a84-4f92-9c34-0fa0c3bfe118 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:35.240157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:35.240871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:35.241163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:35.241441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:35.243276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:35.256681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:35.258376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:35.271041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1262/2494] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:43.182256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3d26-5097-45bc-899a-95d136ea0a93 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:43.183268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3d26-5097-45bc-899a-95d136ea0a93 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:43.183544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3d26-5097-45bc-899a-95d136ea0a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:43.206133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-933b3d26-5097-45bc-899a-95d136ea0a93 None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:43.207317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-933b3d26-5097-45bc-899a-95d136ea0a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:43.258879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1233/2495] 10.222.0.90 () {58 vars in 967 bytes} [Mon Feb 21 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:43.432095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:43.433553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:43.499109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a2158-3806-463f-be04-a3ab6e79f1cb service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:43.504165 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9ed45-074d-4cdf-a90f-8bf065ec74c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:43.504845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ed45-074d-4cdf-a90f-8bf065ec74c3 service swift] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:43.505129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ed45-074d-4cdf-a90f-8bf065ec74c3 service swift] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:43.505409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ed45-074d-4cdf-a90f-8bf065ec74c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:43.513619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9ed45-074d-4cdf-a90f-8bf065ec74c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:43.515200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9ed45-074d-4cdf-a90f-8bf065ec74c3 service swift] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:43.523799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1263/2496] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:39:46.532963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9687-d58c-4ae1-8d72-32bf9d10b870 None None] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.533583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9687-d58c-4ae1-8d72-32bf9d10b870 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.533583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9687-d58c-4ae1-8d72-32bf9d10b870 None None] PATH_INFO: `/` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.538304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1234/2497] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:39:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:39:46.550192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955649-8faa-4c7c-a224-570c1cdb7e80 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.550726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955649-8faa-4c7c-a224-570c1cdb7e80 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.551240 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955649-8faa-4c7c-a224-570c1cdb7e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.573429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-6a955649-8faa-4c7c-a224-570c1cdb7e80 None None] MFA Rules not processed for user `1a673d8aa3054723887a56a4f4f76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:46.575128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6a955649-8faa-4c7c-a224-570c1cdb7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:46.645100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1264/2498] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:46.658235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9687-d58c-4ae1-8d72-32bf9d10b870 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:46.662133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f27f9687-d58c-4ae1-8d72-32bf9d10b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:46.683066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9687-d58c-4ae1-8d72-32bf9d10b870 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:46.690551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bdfd2-84a3-43c4-aa22-c43910f3cb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:46.690551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bdfd2-84a3-43c4-aa22-c43910f3cb35 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.690551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bdfd2-84a3-43c4-aa22-c43910f3cb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.690551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bdfd2-84a3-43c4-aa22-c43910f3cb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.698961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bdfd2-84a3-43c4-aa22-c43910f3cb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:46.700861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bdfd2-84a3-43c4-aa22-c43910f3cb35 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:46.711125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1235/2499] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:46.823955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bae0-c6ec-49ba-9a68-0608bd340bf0 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.824237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bae0-c6ec-49ba-9a68-0608bd340bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.824537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bae0-c6ec-49ba-9a68-0608bd340bf0 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.826722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1265/2500] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:39:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:39:46.833479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a379-e1ab-48df-b5b8-18af7773967b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.834115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a379-e1ab-48df-b5b8-18af7773967b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.834472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a379-e1ab-48df-b5b8-18af7773967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.860659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2c68a379-e1ab-48df-b5b8-18af7773967b None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:46.862312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2c68a379-e1ab-48df-b5b8-18af7773967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:46.877786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1236/2501] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:39:46.892376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bae0-c6ec-49ba-9a68-0608bd340bf0 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:46.897114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-d712bae0-c6ec-49ba-9a68-0608bd340bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:46.920365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bae0-c6ec-49ba-9a68-0608bd340bf0 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:46.924880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:46.925658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.925946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:46.926227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:46.937977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:46.939800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:46.951474 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1266/2502] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:39:46.995023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:46.995679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.000397 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.043260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] MFA Rules not processed for user `4d834a0b1ec1481eaf1387dd4e302cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:39:47.044989 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:47.131048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1237/2503] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:39:47.464960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:47.475311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98444a0-7b82-4c70-8110-f681b80d692c service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:47.480684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:47.481410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:47.481769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:47.482114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:47.484022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:47.494877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:47.513238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:47.513238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1267/2504] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:53.405968 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:53.407462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:53.484866 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322e85-9865-49f3-a8a1-565f9fc2363b None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:53.489303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:53.490167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:53.490448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:53.490719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] PATH_INFO: `/v3/users/c250b028df424333b3a2a87b54fcaef2` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:53.491925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c250b028df424333b3a2a87b54fcaef2)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:53.494069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:53.694172 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c250b028df424333b3a2a87b54fcaef2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:53.695096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c250b028df424333b3a2a87b54fcaef2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:53.702353 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c250b028df424333b3a2a87b54fcaef2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:53.715050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c250b028df424333b3a2a87b54fcaef2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:53.715759 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c250b028df424333b3a2a87b54fcaef2'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:53.805869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1238/2505] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:53 2022] DELETE /identity/v3/users/c250b028df424333b3a2a87b54fcaef2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:54.031445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:54.041865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d52063-cc2e-423f-bc18-ffed7d7b77e3 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:54.098183 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:54.099012 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:54.099385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:54.099555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] PATH_INFO: `/v3/projects/784f5427745d402ba47e692082aac30f` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:54.101225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784f5427745d402ba47e692082aac30f)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:54.103137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:54.201065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784f5427745d402ba47e692082aac30f', 'request_id': 'req-ead2795e-0b36-4ea4-bf81-c6c12b938851'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.273400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784f5427745d402ba47e692082aac30f', 'request_id': 'req-ead2795e-0b36-4ea4-bf81-c6c12b938851'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.280045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784f5427745d402ba47e692082aac30f', 'request_id': 'req-ead2795e-0b36-4ea4-bf81-c6c12b938851'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.290373 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] The token cache is being invalidate because project 784f5427745d402ba47e692082aac30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:54.296468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.296468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.296468 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1268/2506] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:54 2022] DELETE /identity/v3/projects/784f5427745d402ba47e692082aac30f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:54.297293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:54.298662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:54.311942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3ad0-0cf6-4d57-b89e-2a5600dfac2c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:54.364096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:54.364979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:54.365264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:54.365541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] PATH_INFO: `/v3/users/16529c3b76c847d481b1d6876afb5368` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:54.366708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16529c3b76c847d481b1d6876afb5368)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:54.368644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:54.504813 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16529c3b76c847d481b1d6876afb5368'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.506195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16529c3b76c847d481b1d6876afb5368'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.513943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16529c3b76c847d481b1d6876afb5368'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.525764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16529c3b76c847d481b1d6876afb5368'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.526990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16529c3b76c847d481b1d6876afb5368'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:54.594578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1239/2507] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:39:54 2022] DELETE /identity/v3/users/16529c3b76c847d481b1d6876afb5368 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:39:54.801073 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:54.802536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:54.816985 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2795e-0b36-4ea4-bf81-c6c12b938851 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:54.872055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:54.872943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:54.873229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:54.876023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] PATH_INFO: `/v3/projects/73983354768a49ae82e4c10ad46857e7` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:54.876023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73983354768a49ae82e4c10ad46857e7)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:54.876609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:54.976735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73983354768a49ae82e4c10ad46857e7', 'request_id': 'req-19d27622-f4f3-46cd-9e09-21143dffeed2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:55.028359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73983354768a49ae82e4c10ad46857e7', 'request_id': 'req-19d27622-f4f3-46cd-9e09-21143dffeed2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:55.035003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73983354768a49ae82e4c10ad46857e7', 'request_id': 'req-19d27622-f4f3-46cd-9e09-21143dffeed2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:55.047470 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] The token cache is being invalidate because project 73983354768a49ae82e4c10ad46857e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:39:55.047679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:55.048358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-19d27622-f4f3-46cd-9e09-21143dffeed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:39:55.050104 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1269/2508] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:39:54 2022] DELETE /identity/v3/projects/73983354768a49ae82e4c10ad46857e7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:40:14.751406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:14.752879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:14.820370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6ad98-5bda-4efe-b6b1-05b099a05d06 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:14.887391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:14.888195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:14.888513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:14.888794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:14.890565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:14.902130 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:14.903671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:14.913225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1240/2509] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:01.584268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a321-77c7-4802-9d0f-8068ac3f80fa None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:01.584816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a321-77c7-4802-9d0f-8068ac3f80fa None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:01.584906 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a321-77c7-4802-9d0f-8068ac3f80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:01.602327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9cf5a321-77c7-4802-9d0f-8068ac3f80fa None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:01.603511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9cf5a321-77c7-4802-9d0f-8068ac3f80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:01.662071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1270/2510] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:41:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:01.779290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:01.780748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:01.845830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0cac9-941c-46b8-8543-c6beae901891 service placement] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:01.850803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934e58-86df-40a5-b868-d85d032346de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:01.851438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934e58-86df-40a5-b868-d85d032346de service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:01.851723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934e58-86df-40a5-b868-d85d032346de service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:01.852000 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934e58-86df-40a5-b868-d85d032346de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:01.860612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934e58-86df-40a5-b868-d85d032346de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:01.862173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934e58-86df-40a5-b868-d85d032346de service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:01.870577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1241/2511] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:18.040577 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fd33-1647-41a7-8720-037349b764b7 None None] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:18.041166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fd33-1647-41a7-8720-037349b764b7 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:18.041166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fd33-1647-41a7-8720-037349b764b7 None None] PATH_INFO: `/` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:18.042924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1271/2512] 10.222.0.90 () {54 vars in 921 bytes} [Mon Feb 21 01:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:41:18.047831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb25b-9ddb-486a-9594-b89e3d1fdebf None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:18.048294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb25b-9ddb-486a-9594-b89e3d1fdebf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:18.048643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb25b-9ddb-486a-9594-b89e3d1fdebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:18.067312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-864fb25b-9ddb-486a-9594-b89e3d1fdebf None None] MFA Rules not processed for user `8a526052e42248f3a38b329084dd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:18.068534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-864fb25b-9ddb-486a-9594-b89e3d1fdebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:18.134155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1242/2513] 10.222.0.90 () {58 vars in 1018 bytes} [Mon Feb 21 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:18.146300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fd33-1647-41a7-8720-037349b764b7 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:18.148054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2b50fd33-1647-41a7-8720-037349b764b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:18.203630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fd33-1647-41a7-8720-037349b764b7 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:18.207094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f7d6c94406d4ae0aac5f772ff240ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:18.207726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:18.208007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:18.208284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:18.218880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:18.220323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:18.231708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1272/2514] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:20.497018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448903-6e02-4814-be9e-136216f7214e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:20.497493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448903-6e02-4814-be9e-136216f7214e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:20.497608 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448903-6e02-4814-be9e-136216f7214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:20.518008 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-da448903-6e02-4814-be9e-136216f7214e None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:20.519193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-da448903-6e02-4814-be9e-136216f7214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:20.526344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1243/2515] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:20.539141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:20.550610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c14dc-61aa-41bd-b284-f36ffb1e91f0 service glance] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:20.556171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:20.556832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:20.557117 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:20.557395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:20.565260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:20.566864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:20.574752 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1273/2516] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:41.289245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:41.289763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:41.289867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:41.307654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:41.310534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:41.316019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1244/2517] 10.222.0.90 () {58 vars in 967 bytes} [Mon Feb 21 01:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:41.328758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:41.339015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05991c6d-c20a-45d6-b64d-a2e7d25788c5 service swift] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:41.343941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:41.344603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:41.344890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:41.345160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:41.353003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:41.354564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:41.362338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1274/2518] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:43.119712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:43.128279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:43.181025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ddc7-acc0-48d9-a68d-2036e7bf1bfe None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:43.185649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:43.187611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:43.187904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:43.188188 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:43.190140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:43.260191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:43.261943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:43.270903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1245/2519] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:49.811464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:49.820714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb24a-cc11-4f0c-a32f-fcd6c56c7ce1 service swift] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:49.825052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:49.825694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:49.825983 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:49.826261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:49.828055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:49.898710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:49.900827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:49.910313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1275/2520] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:50.101924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:50.103460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:50.114071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10108492-4443-4ef9-b4b8-be2ed6d264dd service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:50.117830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:50.118980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:50.119262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:50.119540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:50.121272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:50.132759 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:50.134817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:50.144615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1246/2521] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:54.328715 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:54.330846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:54.343056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454f36-1de5-45b3-9b02-8a627582beb2 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:54.347854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:54.348757 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:54.349043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:54.349322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] PATH_INFO: `/v3/users/4d834a0b1ec1481eaf1387dd4e302cd3` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:54.350668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d834a0b1ec1481eaf1387dd4e302cd3)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:54.353242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:54.480438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d834a0b1ec1481eaf1387dd4e302cd3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:54.487120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d834a0b1ec1481eaf1387dd4e302cd3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:54.500023 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d834a0b1ec1481eaf1387dd4e302cd3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:54.541840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d834a0b1ec1481eaf1387dd4e302cd3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:54.542738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-3abd5caa-9bbf-4e06-910c-7cabe9d4e46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d834a0b1ec1481eaf1387dd4e302cd3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:54.549484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1276/2522] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:41:54 2022] DELETE /identity/v3/users/4d834a0b1ec1481eaf1387dd4e302cd3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:54.787744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:54.799983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aaca0-2c46-44f2-99c5-25ed54cee1a8 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:54.859659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:54.862588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:54.862588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:54.862588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] PATH_INFO: `/v3/projects/09bc5c58fd414c8aa76756065678191e` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:54.862588 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bc5c58fd414c8aa76756065678191e)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:54.864287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:54.996356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bc5c58fd414c8aa76756065678191e', 'request_id': 'req-1cf335a2-dad2-4f2d-990f-933ea8c421c8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:55.005090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bc5c58fd414c8aa76756065678191e', 'request_id': 'req-1cf335a2-dad2-4f2d-990f-933ea8c421c8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:55.012786 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bc5c58fd414c8aa76756065678191e', 'request_id': 'req-1cf335a2-dad2-4f2d-990f-933ea8c421c8'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:55.095278 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] The token cache is being invalidate because project 09bc5c58fd414c8aa76756065678191e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:41:55.095882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:55.096602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1cf335a2-dad2-4f2d-990f-933ea8c421c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:55.098198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1247/2523] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:41:54 2022] DELETE /identity/v3/projects/09bc5c58fd414c8aa76756065678191e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:55.103191 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.103482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.103780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.121923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:55.123053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:55.184308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1277/2524] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:55.193016 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.193311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.193666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.212754 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:55.213937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:55.221808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1248/2525] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:55.226106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.235532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c962d-f265-4ce5-8c77-a9595b3e3b61 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.240211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.240883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.241168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.241445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.242164 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:41:55.242473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.244126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:55.259536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1278/2526] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:41:55.260706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.270317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf409f-94f9-429e-9834-10b338c54715 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.275728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.276379 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.276717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.276993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.277682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.279562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:55.377401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1249/2527] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:55 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:55.381500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.392527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fade5e-1858-40bf-96cd-5e8fe5d96f01 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.447163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.448210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.448536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.448824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.449545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.451458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:55.528761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1279/2528] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:55 2022] POST /identity/v3/users => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:55.529937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.540774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91717c87-54f6-4335-bbe3-f7d20eae18bc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.546471 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.547620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.548205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.548726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.549671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.552107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:55.564014 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1250/2529] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:41:55.568371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.579585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0bd2-4c7b-4f03-a311-27e4f33d51ab admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.584905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a512a-187b-4898-8840-19ebd508fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.585869 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a512a-187b-4898-8840-19ebd508fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.587086 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a512a-187b-4898-8840-19ebd508fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.587748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a512a-187b-4898-8840-19ebd508fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.588768 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a512a-187b-4898-8840-19ebd508fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.590458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a512a-187b-4898-8840-19ebd508fc73 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:55.601394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1280/2530] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:41:55.605794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.616361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312562-79ae-4c78-835d-cd10b5601cbe admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.625305 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.625925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.626212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.626492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] PATH_INFO: `/v3/projects/5de7dbe91bf744cba64a8b6f4236112b/users/717ba6654b834801be79c281de11f230/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.642922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de7dbe91bf744cba64a8b6f4236112b, user_id=717ba6654b834801be79c281de11f230, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.645673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:55.724043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1251/2531] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:55 2022] PUT /identity/v3/projects/5de7dbe91bf744cba64a8b6f4236112b/users/717ba6654b834801be79c281de11f230/roles/246514336b4549609174329cae41663a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:55.736211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.736211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.736211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.773160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] MFA Rules not processed for user `717ba6654b834801be79c281de11f230`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:55.774532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:55.856695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1281/2532] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:55.861274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:55.930222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91022cd2-6e54-4761-8d19-f6c2422a4d9a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:55.935549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:55.936229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:55.936547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:55.936832 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:55.937691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:55.939615 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.028782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1252/2533] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:55 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:56.029993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.041563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54f728-847f-4976-a404-8697a8447da1 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.102776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.103879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.104370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.104873 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.106335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.108981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.193306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1282/2534] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:56 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:41:56.198017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.208137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f658-637d-4be6-acfe-a8936399e439 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.212877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.213557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.213888 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.214171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.214890 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.216532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.227035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1253/2535] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:41:56.231346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.241233 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514cf22-ab27-47de-826e-ab9da4772977 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.246456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.247335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.247622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.247900 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] PATH_INFO: `/v3/projects/0ba59d1869564350b01a5332fccb56b5/users/9c100f2359234066be574cf7c72c3d9b/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.263433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba59d1869564350b01a5332fccb56b5, user_id=9c100f2359234066be574cf7c72c3d9b, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.266234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.341189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1283/2536] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:56 2022] PUT /identity/v3/projects/0ba59d1869564350b01a5332fccb56b5/users/9c100f2359234066be574cf7c72c3d9b/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:56.345203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.354928 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5de1-2978-403b-a500-328130b93566 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.409696 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcff66-b2af-4812-855e-31bcd76d2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.410393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcff66-b2af-4812-855e-31bcd76d2c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.410671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcff66-b2af-4812-855e-31bcd76d2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.410945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcff66-b2af-4812-855e-31bcd76d2c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.411669 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcff66-b2af-4812-855e-31bcd76d2c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.413288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcff66-b2af-4812-855e-31bcd76d2c62 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.426673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1254/2537] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:41:56.431169 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.442530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ac5f6-ba54-4306-9a70-11cb4b3cda3f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.447788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.448714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.448998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.449279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] PATH_INFO: `/v3/projects/0ba59d1869564350b01a5332fccb56b5/users/9c100f2359234066be574cf7c72c3d9b/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.451222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba59d1869564350b01a5332fccb56b5, user_id=9c100f2359234066be574cf7c72c3d9b, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.453940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.464219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1284/2538] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:41:56 2022] PUT /identity/v3/projects/0ba59d1869564350b01a5332fccb56b5/users/9c100f2359234066be574cf7c72c3d9b/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:56.475340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.475633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.475915 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.502746 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] MFA Rules not processed for user `9c100f2359234066be574cf7c72c3d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:56.503973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:56.578512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1255/2539] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:41:56.587988 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.590393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:56.660722 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfd4d6-4437-4a86-9426-b7c540b92034 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.664299 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bb124-d162-4c35-a330-de5fa22a2698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.665529 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bb124-d162-4c35-a330-de5fa22a2698 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.665806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bb124-d162-4c35-a330-de5fa22a2698 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.666079 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bb124-d162-4c35-a330-de5fa22a2698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.674994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bb124-d162-4c35-a330-de5fa22a2698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.676415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bb124-d162-4c35-a330-de5fa22a2698 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:56.686340 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1285/2540] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:56.813107 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:56.874815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5244a-78e1-4641-a512-789bf31ea306 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:56.879439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:56.880297 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:56.880613 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:56.880910 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] PATH_INFO: `/v3/users/717ba6654b834801be79c281de11f230` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:56.882096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717ba6654b834801be79c281de11f230)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:56.884065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:57.062164 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717ba6654b834801be79c281de11f230'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:57.066161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717ba6654b834801be79c281de11f230'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:57.074647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717ba6654b834801be79c281de11f230'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:57.091680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717ba6654b834801be79c281de11f230'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:57.092551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717ba6654b834801be79c281de11f230'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:57.163950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1256/2541] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:41:56 2022] DELETE /identity/v3/users/717ba6654b834801be79c281de11f230 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:57.166123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:57.166411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:57.166735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:57.197130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:57.198121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:57.275120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1286/2542] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:57.286024 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:57.287429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:57.346611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15471c1-f3ad-44b7-be8f-6ea77cc87170 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:57.350426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:57.350840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:57.351123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:57.351396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:57.361575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:57.363052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:57.372698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1257/2543] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:57.796093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:57.797648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:57.809739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c2401-46e1-45f6-8087-81cf753a2f5c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:57.816535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:57.817510 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:57.817792 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:57.818151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] PATH_INFO: `/v3/users/07356563a079427b97e47ce2a11b54b7` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:57.819548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=07356563a079427b97e47ce2a11b54b7)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:57.821534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:57.914835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:57.916961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:57.931432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63a6b-57b5-4583-986a-fbb9d4024926 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:57.936818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:57.937714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:57.937956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:57.938231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] PATH_INFO: `/v3/projects/5de7dbe91bf744cba64a8b6f4236112b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:57.939421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de7dbe91bf744cba64a8b6f4236112b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:57.941679 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:58.030162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07356563a079427b97e47ce2a11b54b7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.038821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07356563a079427b97e47ce2a11b54b7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.055029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07356563a079427b97e47ce2a11b54b7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.085165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de7dbe91bf744cba64a8b6f4236112b', 'request_id': 'req-28aa21ef-9ddb-495b-afae-2855be3fcb12'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.095330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de7dbe91bf744cba64a8b6f4236112b', 'request_id': 'req-28aa21ef-9ddb-495b-afae-2855be3fcb12'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.100935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de7dbe91bf744cba64a8b6f4236112b', 'request_id': 'req-28aa21ef-9ddb-495b-afae-2855be3fcb12'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.136650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07356563a079427b97e47ce2a11b54b7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.137407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07356563a079427b97e47ce2a11b54b7'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.145162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1287/2544] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:41:57 2022] DELETE /identity/v3/users/07356563a079427b97e47ce2a11b54b7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:58.204907 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] The token cache is being invalidate because project 5de7dbe91bf744cba64a8b6f4236112b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:41:58.205200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.205896 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.207432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1258/2545] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:41:57 2022] DELETE /identity/v3/projects/5de7dbe91bf744cba64a8b6f4236112b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:58.211386 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:58.213559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:58.283252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43448-2640-4a16-9172-bc61ccd46bfe admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:58.288123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:58.289119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:58.289408 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:58.289716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] PATH_INFO: `/v3/users/9c100f2359234066be574cf7c72c3d9b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:58.290916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c100f2359234066be574cf7c72c3d9b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:58.292907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:58.428484 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:58.429923 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:58.498809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa21ef-9ddb-495b-afae-2855be3fcb12 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:58.503605 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:58.504482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:58.504797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:58.505066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] PATH_INFO: `/v3/projects/360e1042eb3f47f5be6a603e1877d9d8` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:58.506228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360e1042eb3f47f5be6a603e1877d9d8)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:58.508104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:58.543136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c100f2359234066be574cf7c72c3d9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.549817 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c100f2359234066be574cf7c72c3d9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.564577 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c100f2359234066be574cf7c72c3d9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.622863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360e1042eb3f47f5be6a603e1877d9d8', 'request_id': 'req-e7d66990-26f3-4f7c-a539-2dbe40a0b471'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.629682 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360e1042eb3f47f5be6a603e1877d9d8', 'request_id': 'req-e7d66990-26f3-4f7c-a539-2dbe40a0b471'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.632481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c100f2359234066be574cf7c72c3d9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.633119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c100f2359234066be574cf7c72c3d9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.636355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360e1042eb3f47f5be6a603e1877d9d8', 'request_id': 'req-e7d66990-26f3-4f7c-a539-2dbe40a0b471'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.640807 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1288/2546] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:41:58 2022] DELETE /identity/v3/users/9c100f2359234066be574cf7c72c3d9b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:41:58.715525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] The token cache is being invalidate because project 360e1042eb3f47f5be6a603e1877d9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:41:58.715815 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.716464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.718216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1259/2547] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:41:58 2022] DELETE /identity/v3/projects/360e1042eb3f47f5be6a603e1877d9d8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:58.722280 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:58.723704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:58.791420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153158-b25c-4763-9ddb-10ee2d7f5b46 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:58.796041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:58.796874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:58.797438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:58.797438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] PATH_INFO: `/v3/users/d09cd0b15e3d4305b7831fcf580e081a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:58.798596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09cd0b15e3d4305b7831fcf580e081a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:58.800540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:58.984658 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09cd0b15e3d4305b7831fcf580e081a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:58.991618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09cd0b15e3d4305b7831fcf580e081a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.003842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09cd0b15e3d4305b7831fcf580e081a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.049584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09cd0b15e3d4305b7831fcf580e081a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.050150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09cd0b15e3d4305b7831fcf580e081a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.057438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1289/2548] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:41:58 2022] DELETE /identity/v3/users/d09cd0b15e3d4305b7831fcf580e081a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:59.262525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.263984 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:59.294708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.296140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:59.333066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d66990-26f3-4f7c-a539-2dbe40a0b471 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.362733 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7fb7-7cd6-45b9-b362-c495d6401945 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.367467 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.368354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.368671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.368953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] PATH_INFO: `/v3/projects/9af84fdd4f364c28821c9c8ce4ed812d` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.370141 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af84fdd4f364c28821c9c8ce4ed812d)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.372058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.388082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.388965 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.389246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.389515 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] PATH_INFO: `/v3/projects/0ba59d1869564350b01a5332fccb56b5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.390683 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba59d1869564350b01a5332fccb56b5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.392599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.459222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af84fdd4f364c28821c9c8ce4ed812d', 'request_id': 'req-84534c9c-1406-49dd-834a-97b29d19fc80'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.481019 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba59d1869564350b01a5332fccb56b5', 'request_id': 'req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.486903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba59d1869564350b01a5332fccb56b5', 'request_id': 'req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.492041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba59d1869564350b01a5332fccb56b5', 'request_id': 'req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.523122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af84fdd4f364c28821c9c8ce4ed812d', 'request_id': 'req-84534c9c-1406-49dd-834a-97b29d19fc80'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.530441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af84fdd4f364c28821c9c8ce4ed812d', 'request_id': 'req-84534c9c-1406-49dd-834a-97b29d19fc80'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.540800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] The token cache is being invalidate because project 9af84fdd4f364c28821c9c8ce4ed812d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:41:59.541082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.541697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-84534c9c-1406-49dd-834a-97b29d19fc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.543208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1290/2549] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:41:59 2022] DELETE /identity/v3/projects/9af84fdd4f364c28821c9c8ce4ed812d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:59.548040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419614b2-1a71-45c0-9c7f-3e636881c35d None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.548328 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419614b2-1a71-45c0-9c7f-3e636881c35d None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.548696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419614b2-1a71-45c0-9c7f-3e636881c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.565928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-419614b2-1a71-45c0-9c7f-3e636881c35d None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:59.567060 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-419614b2-1a71-45c0-9c7f-3e636881c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:59.608022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] The token cache is being invalidate because project 0ba59d1869564350b01a5332fccb56b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:41:59.608451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.609090 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ccc35cbe-c94d-4cf3-bf61-365dbf259c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:41:59.610723 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1260/2550] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:41:59 2022] DELETE /identity/v3/projects/0ba59d1869564350b01a5332fccb56b5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:41:59.615535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13691a78-fb0b-43f0-a118-23cba15e89c4 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.615875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13691a78-fb0b-43f0-a118-23cba15e89c4 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.616160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13691a78-fb0b-43f0-a118-23cba15e89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.623995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1291/2551] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:59.631384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.631668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.631943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.636787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-13691a78-fb0b-43f0-a118-23cba15e89c4 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:59.637993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-13691a78-fb0b-43f0-a118-23cba15e89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:59.646205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1261/2552] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:59.650872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:59.652236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:59.654185 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.654474 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.654750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.660214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1292/2553] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:59.664027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.672730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:41:59.672929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722aa78-c9fc-4aea-bfaf-39386bc3183f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.673824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:59.677590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.678261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.678545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.678818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.679534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:41:59.679836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.681449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.682254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1262/2554] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:41:59.686263 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.692919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1293/2555] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:41:59.695412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd6b9-7e37-4bf7-ad81-69453192328e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.697337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.700869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.701513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.701797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.702076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.702916 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:41:59.703230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.704853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.706576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c661-ee19-4cb7-a919-ee2e3b281ebd admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.711226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.712389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.712712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.712987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.713661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.715525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.716761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1263/2556] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:41:59.720998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.730438 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd783-9429-4129-a13f-9f47ebcadf82 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.735117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.735752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.736037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.736309 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.737050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.738946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.811129 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1294/2557] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:41:59.815225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.828985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1264/2558] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:41:59.837144 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.876325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb79bf8-8ae4-4b56-9c06-fcbd8385022f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.896302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798908-cb48-4cbd-90d7-8af9fb6d4fde admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:59.901145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.901838 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.902122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.902399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.903086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.905127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.931142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:59.931804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:59.932084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:59.932358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:59.933069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:59.934978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:59.981363 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1265/2559] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:41:59.985600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:59.995254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd396e-c49d-47ae-a51b-7258aa94c458 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.000131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.000822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.001089 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.001360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.002069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.003662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.005728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1295/2560] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:41:59 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:00.013711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.017702 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1266/2561] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:00.018689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.023178 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b47d3-5eac-40b1-849a-fbef70f80513 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.028969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6870a-8621-4632-9ae0-dddb19eb74cc admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.030855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.031526 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.031820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.032099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.032888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.033840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.034486 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.034610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.034763 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.035033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.038479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.038809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.048250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1296/2562] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:00.052707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.054321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1267/2563] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:00.062725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.067306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4ea3-e8b2-42f4-8bfa-04f41d101e66 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.073425 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.074099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.074536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.074904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.075721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.077012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e63c-8cb7-4cb2-b64d-c456d7707d9c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.077689 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.121574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24efc-734b-4cfb-92f3-e939da3cf210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.121574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24efc-734b-4cfb-92f3-e939da3cf210 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.121574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24efc-734b-4cfb-92f3-e939da3cf210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.121574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24efc-734b-4cfb-92f3-e939da3cf210 admin admin] PATH_INFO: `/v3/projects/35440a2599d4420589f0908acc19ca23/users/3f983a972f80427e83bccf7d038115af/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.122083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1297/2564] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:00.122083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.122304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24efc-734b-4cfb-92f3-e939da3cf210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35440a2599d4420589f0908acc19ca23, user_id=3f983a972f80427e83bccf7d038115af, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.122304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24efc-734b-4cfb-92f3-e939da3cf210 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.122500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9725-46e7-4fe1-b553-94c9631adf08 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.122500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8030-539f-46c3-b206-0b425dc50815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.122500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8030-539f-46c3-b206-0b425dc50815 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.122500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8030-539f-46c3-b206-0b425dc50815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.122886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8030-539f-46c3-b206-0b425dc50815 admin admin] PATH_INFO: `/v3/projects/94593ad3d3934da1ab80ce0c851c7d3e/users/fa4b889b3aff47cea0a0d254870515cd/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.130844 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8030-539f-46c3-b206-0b425dc50815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94593ad3d3934da1ab80ce0c851c7d3e, user_id=fa4b889b3aff47cea0a0d254870515cd, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.134246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8030-539f-46c3-b206-0b425dc50815 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.226961 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1268/2565] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:00 2022] PUT /identity/v3/projects/35440a2599d4420589f0908acc19ca23/users/3f983a972f80427e83bccf7d038115af/roles/246514336b4549609174329cae41663a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:00.237419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.237729 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.238020 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.238413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1298/2566] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:00 2022] PUT /identity/v3/projects/94593ad3d3934da1ab80ce0c851c7d3e/users/fa4b889b3aff47cea0a0d254870515cd/roles/246514336b4549609174329cae41663a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:00.243863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.244157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.244458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.261184 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:00.262416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:00.264109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] MFA Rules not processed for user `3f983a972f80427e83bccf7d038115af`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:00.265338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:00.319785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1299/2567] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:00.328520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1269/2568] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:00.329442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.330786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:00.332574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.342459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26f6ff-03da-4101-9dcb-2bb8726063ad None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.346986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.347616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.347893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.348168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.348875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.350742 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.387097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80925a-a4b5-4a2c-b316-1f7d58b16efb None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.390673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.391310 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.391596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.391874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.401372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.402878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.412109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1300/2569] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:00.439676 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1270/2570] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:00 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:00.443655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.453516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e76ffb-176c-4c2b-8329-f700b1fdfd1b service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.506681 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.507350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.507639 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.507919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.509220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.511402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.579000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1301/2571] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:00 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:00.580567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.591703 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f17feb-3476-4186-92e4-a353cd7152c4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.596419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.597170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.599892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.599892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.599892 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.600170 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.610205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1271/2572] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:00.614345 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.624763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f80c8-3e68-42cf-a4f4-52d4e64ed72f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.629763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.630632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.630911 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.631182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] PATH_INFO: `/v3/projects/72fef7c6addc4a0a9c15e6d34b404f5f/users/436d4c0ce8094a53808fe28d3f53e86d/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.646953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fef7c6addc4a0a9c15e6d34b404f5f, user_id=436d4c0ce8094a53808fe28d3f53e86d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.649582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.718235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1302/2573] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:00 2022] PUT /identity/v3/projects/72fef7c6addc4a0a9c15e6d34b404f5f/users/436d4c0ce8094a53808fe28d3f53e86d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:00.722295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.731925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d131c-1691-41cb-af33-f31c144a502a admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.785653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5bee-6182-4ad3-b141-5e3443f7ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.786307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5bee-6182-4ad3-b141-5e3443f7ad8e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.786585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5bee-6182-4ad3-b141-5e3443f7ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.786855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5bee-6182-4ad3-b141-5e3443f7ad8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.787568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5bee-6182-4ad3-b141-5e3443f7ad8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.789202 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5bee-6182-4ad3-b141-5e3443f7ad8e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.798863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1272/2574] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:00.803175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.814247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123e045-3988-4615-9e0a-ba0b83487cc9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:00.818912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:00.819779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.820059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.820330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] PATH_INFO: `/v3/projects/72fef7c6addc4a0a9c15e6d34b404f5f/users/436d4c0ce8094a53808fe28d3f53e86d/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.822893 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fef7c6addc4a0a9c15e6d34b404f5f, user_id=436d4c0ce8094a53808fe28d3f53e86d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:00.825632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:00.835980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1303/2575] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:00 2022] PUT /identity/v3/projects/72fef7c6addc4a0a9c15e6d34b404f5f/users/436d4c0ce8094a53808fe28d3f53e86d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:00.847957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee219-a455-474c-969e-295f971393e2 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:00.848326 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee219-a455-474c-969e-295f971393e2 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:00.848641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee219-a455-474c-969e-295f971393e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:00.878209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-00fee219-a455-474c-969e-295f971393e2 None None] MFA Rules not processed for user `436d4c0ce8094a53808fe28d3f53e86d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:00.879402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-00fee219-a455-474c-969e-295f971393e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:00.953761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1273/2576] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:00.963815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:00.965537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:01.029912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13565372-210d-44b9-804a-f7b6d1267e07 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:01.033687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05300-845c-4eeb-bcb0-85ecf94dea06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:01.034329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05300-845c-4eeb-bcb0-85ecf94dea06 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:01.034672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05300-845c-4eeb-bcb0-85ecf94dea06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:01.034954 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05300-845c-4eeb-bcb0-85ecf94dea06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:01.045016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05300-845c-4eeb-bcb0-85ecf94dea06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:01.046466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05300-845c-4eeb-bcb0-85ecf94dea06 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:01.056790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1304/2577] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:01.965071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee219-a455-474c-969e-295f971393e2 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:02.030677 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee219-a455-474c-969e-295f971393e2 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:02.036153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:02.037407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:02.037851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:02.038196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] PATH_INFO: `/v3/users/3f983a972f80427e83bccf7d038115af` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:02.039732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f983a972f80427e83bccf7d038115af)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:02.042539 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:02.229879 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f983a972f80427e83bccf7d038115af'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:02.234573 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f983a972f80427e83bccf7d038115af'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:02.238279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f983a972f80427e83bccf7d038115af'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:02.253586 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f983a972f80427e83bccf7d038115af'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:02.254711 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f983a972f80427e83bccf7d038115af'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:02.354936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1274/2578] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:01 2022] DELETE /identity/v3/users/3f983a972f80427e83bccf7d038115af => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:02.362244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:02.362770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:02.362877 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:02.380995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:02.382186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:02.452099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1305/2579] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:02.468520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:02.470255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:02.532755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342d27c-7c9e-44d4-82a3-f600bb8109e2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:02.536564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:02.537727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:02.537999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:02.538273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:02.548231 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:02.549699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:02.559862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1275/2580] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:03.271625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:03.273515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:03.302714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d18513-6836-49b7-a6b2-28b55a94e758 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:03.309898 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:03.311123 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:03.311727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:03.312099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] PATH_INFO: `/v3/projects/35440a2599d4420589f0908acc19ca23` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:03.314201 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35440a2599d4420589f0908acc19ca23)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:03.317439 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:03.458464 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35440a2599d4420589f0908acc19ca23', 'request_id': 'req-4567fd90-727b-4aaa-b3d4-06c07d0686d4'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.569405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35440a2599d4420589f0908acc19ca23', 'request_id': 'req-4567fd90-727b-4aaa-b3d4-06c07d0686d4'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.576378 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35440a2599d4420589f0908acc19ca23', 'request_id': 'req-4567fd90-727b-4aaa-b3d4-06c07d0686d4'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.589228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] The token cache is being invalidate because project 35440a2599d4420589f0908acc19ca23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:03.589789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.590621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.592446 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1306/2581] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:03 2022] DELETE /identity/v3/projects/35440a2599d4420589f0908acc19ca23 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:03.601567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:03.620578 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa1b7c-a8dd-4330-b79c-b6a426e1cd6b service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:03.687817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:03.688059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:03.688291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:03.688601 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] PATH_INFO: `/v3/users/436d4c0ce8094a53808fe28d3f53e86d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:03.689814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=436d4c0ce8094a53808fe28d3f53e86d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:03.691733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:03.895858 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436d4c0ce8094a53808fe28d3f53e86d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.896849 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436d4c0ce8094a53808fe28d3f53e86d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.905321 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436d4c0ce8094a53808fe28d3f53e86d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.918974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436d4c0ce8094a53808fe28d3f53e86d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.920064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd78ec5e-6f80-4844-8a41-33c6b92ef75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436d4c0ce8094a53808fe28d3f53e86d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:03.998877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1276/2582] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:03 2022] DELETE /identity/v3/users/436d4c0ce8094a53808fe28d3f53e86d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:04.574905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:04.580150 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:04.594748 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567fd90-727b-4aaa-b3d4-06c07d0686d4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:04.681013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:04.683211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:04.688663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:04.689195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] PATH_INFO: `/v3/projects/72fef7c6addc4a0a9c15e6d34b404f5f` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:04.690970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fef7c6addc4a0a9c15e6d34b404f5f)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:04.693285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:04.821711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fef7c6addc4a0a9c15e6d34b404f5f', 'request_id': 'req-208b0c03-94c7-4ef6-9c65-c1797a9903f2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:04.889631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fef7c6addc4a0a9c15e6d34b404f5f', 'request_id': 'req-208b0c03-94c7-4ef6-9c65-c1797a9903f2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:04.896744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fef7c6addc4a0a9c15e6d34b404f5f', 'request_id': 'req-208b0c03-94c7-4ef6-9c65-c1797a9903f2'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:04.913483 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] The token cache is being invalidate because project 72fef7c6addc4a0a9c15e6d34b404f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:04.913850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:04.915131 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-208b0c03-94c7-4ef6-9c65-c1797a9903f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:04.918687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1307/2583] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:04 2022] DELETE /identity/v3/projects/72fef7c6addc4a0a9c15e6d34b404f5f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:04.923926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:04.924797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:04.925242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:04.950151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:04.953987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:05.033460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1277/2584] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:05.041711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.042095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.042453 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.065717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:05.067035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:05.075700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1308/2585] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:05.080289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.091538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a4211-a02e-4a7b-bbdb-e3a21eba0880 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.096138 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.096800 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.097076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.097345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.098088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:05.098585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.100175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.112957 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1278/2586] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:05.117520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.126855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba248-9514-4c08-bf6b-c6a108778fbc None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.131590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.132207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.132524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.132800 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.133540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.135442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.232493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1309/2587] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:05.237056 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.258777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bfce3-0ddf-4c5d-9837-c485da3a07d1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.335664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.335664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.335664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.335664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.335995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.337166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.413158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1279/2588] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:05.418747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.435732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68551ed-5e57-4202-8225-c4bdd56ec30b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.449140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.450029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.450572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.450972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.452109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.454189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.472581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1310/2589] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:05.473930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.491656 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee0cf2-f2f3-4d2b-be4b-f1ee1de31694 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.497091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985adb53-5f0a-40eb-8fd1-6872c02b1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.497788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985adb53-5f0a-40eb-8fd1-6872c02b1b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.498071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985adb53-5f0a-40eb-8fd1-6872c02b1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.498345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985adb53-5f0a-40eb-8fd1-6872c02b1b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.499740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985adb53-5f0a-40eb-8fd1-6872c02b1b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.501422 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985adb53-5f0a-40eb-8fd1-6872c02b1b4a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.515091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1280/2590] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:05.518996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.530397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18742d38-6946-40e6-a395-4420eaf177d0 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.535974 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a4a1-c4d8-42cb-8d3f-9d11c482c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.536955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a4a1-c4d8-42cb-8d3f-9d11c482c2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.537235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a4a1-c4d8-42cb-8d3f-9d11c482c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.538155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a4a1-c4d8-42cb-8d3f-9d11c482c2f5 admin admin] PATH_INFO: `/v3/projects/1efd3093253a4e8484f44f26b60e8c43/users/f2e878b0f391499bacb631ef357aac2e/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.557209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296a4a1-c4d8-42cb-8d3f-9d11c482c2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efd3093253a4e8484f44f26b60e8c43, user_id=f2e878b0f391499bacb631ef357aac2e, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.559917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296a4a1-c4d8-42cb-8d3f-9d11c482c2f5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.610851 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.611142 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.611427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.644570 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] MFA Rules not processed for user `fa4b889b3aff47cea0a0d254870515cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:05.646395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:05.651162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1311/2591] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:05 2022] PUT /identity/v3/projects/1efd3093253a4e8484f44f26b60e8c43/users/f2e878b0f391499bacb631ef357aac2e/roles/246514336b4549609174329cae41663a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:05.661514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.662081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.662786 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.701584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] MFA Rules not processed for user `f2e878b0f391499bacb631ef357aac2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:05.703239 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:05.718299 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1281/2592] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:05.722704 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.724050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:05.784400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1312/2593] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:05.788818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:05.813339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57a093-5245-4248-98f1-456f136a18d8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.818182 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.818875 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.819155 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.819431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.820127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.822769 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.874838 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb7037-c733-4762-a04a-7dad852e1e22 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:05.879899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:05.880691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:05.880948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:05.881223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:05.881922 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:05.884884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:05.944861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1282/2594] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:05.947023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.018178 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c2c1a-ef14-4be7-9287-ba18f5d1e669 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.023171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.024062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.024176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.024411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.025339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.025485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1313/2595] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/projects => generated 367 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:06.029278 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.030372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.093030 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca7cc-e5d4-47d4-98e8-9a58d158f816 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.097874 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.104708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.104708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.104708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.104708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.104708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.136653 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1283/2596] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:05 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:06.140808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.150959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015c12-6e44-4ded-921b-0b8932e57ccf admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.155732 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.156380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.156722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.156985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.157706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.159294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.169513 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1284/2597] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:06.174032 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.183895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c7f3f-4e6a-467e-895c-7ac8c43965b4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.188655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.189493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.189773 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.190045 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] PATH_INFO: `/v3/projects/30a4a0e1e7ea49c382312c6ffc46cbd4/users/46dad744629f43fd9c7c4b0ac2d7bbc5/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.203850 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1314/2598] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:06 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:06.205447 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a4a0e1e7ea49c382312c6ffc46cbd4, user_id=46dad744629f43fd9c7c4b0ac2d7bbc5, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.207716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.208161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.217056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4cff8-f8c8-4ea3-b094-6473897a521b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.221677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.222320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.222602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.222881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.223598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.225261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.235361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1315/2599] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:06.239395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.250052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b4ab1-dcfe-4e5a-a0be-4d5d28527c6f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.257357 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.259142 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.259671 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.260203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] PATH_INFO: `/v3/projects/b4eec5ff783e4809b72289eb9b01be37/users/87d543272c0745819574cea742e1c90c/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.278350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eec5ff783e4809b72289eb9b01be37, user_id=87d543272c0745819574cea742e1c90c, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.281047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.289843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1285/2600] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:06 2022] PUT /identity/v3/projects/30a4a0e1e7ea49c382312c6ffc46cbd4/users/46dad744629f43fd9c7c4b0ac2d7bbc5/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:06.293627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.346546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1316/2601] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:06 2022] PUT /identity/v3/projects/b4eec5ff783e4809b72289eb9b01be37/users/87d543272c0745819574cea742e1c90c/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:06.350395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.354102 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5819-35a4-4141-8bf1-5b65a5bb9101 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.407277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.407939 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.408218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.408524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.409239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.410804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.411444 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099db1a3-a13d-4ef3-b831-589a9ee62127 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.416779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.417438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.417726 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.418005 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.418725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.420326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.423770 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1286/2602] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:06.424795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.434429 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1317/2603] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:06.434922 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877888f-6b28-4355-8fe4-779572f8e915 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.435596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.439621 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2463007-0d20-4fdd-a165-301be5c706ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.440525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2463007-0d20-4fdd-a165-301be5c706ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.440852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2463007-0d20-4fdd-a165-301be5c706ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.441136 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2463007-0d20-4fdd-a165-301be5c706ba admin admin] PATH_INFO: `/v3/projects/30a4a0e1e7ea49c382312c6ffc46cbd4/users/46dad744629f43fd9c7c4b0ac2d7bbc5/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.443135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2463007-0d20-4fdd-a165-301be5c706ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a4a0e1e7ea49c382312c6ffc46cbd4, user_id=46dad744629f43fd9c7c4b0ac2d7bbc5, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.445018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a34d4-e0bb-4cc2-8323-25c2b6837f60 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.445889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2463007-0d20-4fdd-a165-301be5c706ba admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.450222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.451088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.451372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.451649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] PATH_INFO: `/v3/projects/b4eec5ff783e4809b72289eb9b01be37/users/87d543272c0745819574cea742e1c90c/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.453676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eec5ff783e4809b72289eb9b01be37, user_id=87d543272c0745819574cea742e1c90c, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.456260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1287/2604] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:06 2022] PUT /identity/v3/projects/30a4a0e1e7ea49c382312c6ffc46cbd4/users/46dad744629f43fd9c7c4b0ac2d7bbc5/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:06.456397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.469032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1318/2605] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:06 2022] PUT /identity/v3/projects/b4eec5ff783e4809b72289eb9b01be37/users/87d543272c0745819574cea742e1c90c/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:06.487077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.487360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.487644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.515929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] MFA Rules not processed for user `87d543272c0745819574cea742e1c90c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:06.517260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:06.587314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1288/2606] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:06.597668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.599469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:06.665084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac4fa1-7939-4e7a-a562-d198972f5f1a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.668992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.669774 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.670072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.670416 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.684307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.685842 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.695818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1319/2607] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:06.808366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:06.809969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:06.821936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a481760-9c23-406d-b4b3-fbd34eb8723c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:06.825574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d666219-2787-4688-a053-b451ca235e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:06.826267 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666219-2787-4688-a053-b451ca235e40 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:06.826546 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666219-2787-4688-a053-b451ca235e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:06.826841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666219-2787-4688-a053-b451ca235e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:06.886254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d666219-2787-4688-a053-b451ca235e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:06.887697 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d666219-2787-4688-a053-b451ca235e40 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:06.897482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1289/2608] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:11.904895 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.008763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdc4fb-ec7f-4db6-8b19-0d26b7d74100 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.013987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.014891 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.015172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.015447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] PATH_INFO: `/v3/users/f2e878b0f391499bacb631ef357aac2e` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.016801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e878b0f391499bacb631ef357aac2e)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.018854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.215440 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e878b0f391499bacb631ef357aac2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.224211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e878b0f391499bacb631ef357aac2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.238562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e878b0f391499bacb631ef357aac2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.307134 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e878b0f391499bacb631ef357aac2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.309182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e878b0f391499bacb631ef357aac2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:12.316456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1320/2609] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:11 2022] DELETE /identity/v3/users/f2e878b0f391499bacb631ef357aac2e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:12.322055 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718b4e-ee84-4054-8eb1-b5acb1d850f9 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.322593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718b4e-ee84-4054-8eb1-b5acb1d850f9 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.322593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718b4e-ee84-4054-8eb1-b5acb1d850f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.341159 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-11718b4e-ee84-4054-8eb1-b5acb1d850f9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:12.342590 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-11718b4e-ee84-4054-8eb1-b5acb1d850f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.420393 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1290/2610] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:12.433822 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.436665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.520368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0f12-9cd8-45a2-84d2-1f7d8ec24754 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.524769 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.525409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.526002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.526353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.540072 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.542006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.555888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1321/2611] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:12.691200 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.691496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.691994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.722329 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] MFA Rules not processed for user `46dad744629f43fd9c7c4b0ac2d7bbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:12.723680 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.796820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1291/2612] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:12.808026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:12.810311 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.882437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12bb9b-464e-4911-a901-dafaa4cced28 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:12.889353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:12.892140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:12.892140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:12.892140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:12.892935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:12.955636 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:12.957297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:12.966761 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1322/2613] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:13.079161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:13.080737 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:13.094525 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59b5de-b8bf-4d78-a9ee-b7e4bdb56a75 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:13.099356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:13.100224 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:13.100528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:13.100798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] PATH_INFO: `/v3/projects/1efd3093253a4e8484f44f26b60e8c43` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:13.102818 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efd3093253a4e8484f44f26b60e8c43)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:13.104714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:13.215242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efd3093253a4e8484f44f26b60e8c43', 'request_id': 'req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.221308 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efd3093253a4e8484f44f26b60e8c43', 'request_id': 'req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.227092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efd3093253a4e8484f44f26b60e8c43', 'request_id': 'req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.316150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] The token cache is being invalidate because project 1efd3093253a4e8484f44f26b60e8c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:13.316448 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.317080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.318596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1292/2614] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:13 2022] DELETE /identity/v3/projects/1efd3093253a4e8484f44f26b60e8c43 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:13.323274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:13.333634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef13c0-65e5-4279-825b-d0caff30de88 service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:13.390554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:13.391428 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:13.391713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:13.391991 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] PATH_INFO: `/v3/users/87d543272c0745819574cea742e1c90c` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:13.393235 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d543272c0745819574cea742e1c90c)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:13.395195 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:13.635279 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d543272c0745819574cea742e1c90c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.642419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d543272c0745819574cea742e1c90c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.653935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d543272c0745819574cea742e1c90c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.729610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d543272c0745819574cea742e1c90c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.730182 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-aa585143-e766-47cd-972c-7f66402599a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d543272c0745819574cea742e1c90c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:13.737015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1323/2615] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:13 2022] DELETE /identity/v3/users/87d543272c0745819574cea742e1c90c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:14.143649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:14.146880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:14.159253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7b58-5f73-4bf5-9515-0cbfd309efc1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:14.223070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:14.224059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:14.224461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:14.224864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] PATH_INFO: `/v3/projects/b4eec5ff783e4809b72289eb9b01be37` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:14.226274 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4eec5ff783e4809b72289eb9b01be37)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:14.229105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:14.394488 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4eec5ff783e4809b72289eb9b01be37', 'request_id': 'req-7d686673-2a33-4267-a727-71468e255241'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:14.402782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4eec5ff783e4809b72289eb9b01be37', 'request_id': 'req-7d686673-2a33-4267-a727-71468e255241'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:14.409715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4eec5ff783e4809b72289eb9b01be37', 'request_id': 'req-7d686673-2a33-4267-a727-71468e255241'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:14.491153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] The token cache is being invalidate because project b4eec5ff783e4809b72289eb9b01be37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:14.491450 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:14.492549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7d686673-2a33-4267-a727-71468e255241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:14.496871 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1293/2616] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:14 2022] DELETE /identity/v3/projects/b4eec5ff783e4809b72289eb9b01be37 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:14.502584 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:14.503040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:14.503137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:14.523144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:14.525393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:14.599679 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1324/2617] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:14.607672 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:14.607964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:14.608293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:14.639898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:14.641803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:14.653150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1294/2618] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:14.657455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:14.673827 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404ee0-d4fa-4bae-aaed-52f411854c47 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:14.679469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:14.685737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:14.685737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:14.685737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:14.685737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:14.685737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:14.685737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:14.702651 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1325/2619] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:42:14.707077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:14.721236 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9ec16-4939-4daf-95b9-1a4d7681a21e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:14.732934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:14.733898 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:14.734186 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:14.734461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:14.735693 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:14.738043 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:14.904725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1295/2620] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:14 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:14.905447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:14.917250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e943e-b5a3-45f8-999a-b7ccb26c9ec1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:15.010057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:15.012710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:15.012885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:15.013162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:15.014175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:15.015970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:15.123553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1326/2621] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:14 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:15.128100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:15.142031 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217ddcd-6cd9-423a-84af-ad9185d19e65 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:15.147161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:15.147853 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:15.148128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:15.148579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:15.149193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:15.150787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:15.165292 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1296/2622] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:15.166307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:15.176762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769baf-429b-40d1-8e67-463a907f9015 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:15.187697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed2b56-93d4-4f82-b2ff-0cba367def9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:15.187697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed2b56-93d4-4f82-b2ff-0cba367def9b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:15.187697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed2b56-93d4-4f82-b2ff-0cba367def9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:15.187697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed2b56-93d4-4f82-b2ff-0cba367def9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:15.188125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed2b56-93d4-4f82-b2ff-0cba367def9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:15.188125 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed2b56-93d4-4f82-b2ff-0cba367def9b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:15.197396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1327/2623] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:15.201657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:15.212253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d9e93-6df7-496b-84d0-848a847f3135 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:15.217083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:15.218137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:15.218423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:15.218766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] PATH_INFO: `/v3/projects/6b2c161e9f0b4b4ea42fdb52ad3617d3/users/213f01df87d04ad5bae09859531f680e/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:15.234357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2c161e9f0b4b4ea42fdb52ad3617d3, user_id=213f01df87d04ad5bae09859531f680e, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:15.236626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:15.313668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1297/2624] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:15 2022] PUT /identity/v3/projects/6b2c161e9f0b4b4ea42fdb52ad3617d3/users/213f01df87d04ad5bae09859531f680e/roles/246514336b4549609174329cae41663a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:15.319456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bcd8f-686c-4ebc-ab52-1d261de99dbc None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:15.319741 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bcd8f-686c-4ebc-ab52-1d261de99dbc None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:15.320026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bcd8f-686c-4ebc-ab52-1d261de99dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:15.338542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-aa4bcd8f-686c-4ebc-ab52-1d261de99dbc None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:15.340069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-aa4bcd8f-686c-4ebc-ab52-1d261de99dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:15.404819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1328/2625] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:15.414945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:15.416792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:15.481531 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c0fb-5992-4f78-9007-ccbb1e176f12 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:15.485407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:15.486139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:15.486493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:15.487235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:15.500544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:15.502705 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:15.517465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1298/2626] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:17.040824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.041296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.041559 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.070426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] MFA Rules not processed for user `213f01df87d04ad5bae09859531f680e`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:17.071796 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:17.136931 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1329/2627] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:17.141419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:17.151490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3e1d9-2c13-4932-b0d9-db018369107a service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:17.156279 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:17.156959 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.157244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.157517 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.158195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:17.160084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:17.244909 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1299/2628] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:17 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:17.249170 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:17.259868 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f73d1-468f-4c41-a45a-3d68cf6c203f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:17.316370 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:17.318387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.318387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.318387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.318387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:17.320307 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:17.415451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1330/2629] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:17 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:17.419483 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:17.429596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d548-b8ec-4e9d-aa94-813870df6cb9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:17.434228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:17.434885 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.435176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.435455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.436179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:17.437863 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:17.449030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1300/2630] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:17.453242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:17.463487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2221e9-45c2-425a-af16-79af3883061e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:17.469358 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:17.470244 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.470532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.470843 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] PATH_INFO: `/v3/projects/0063b207a684478c82ce3efbdf46a3b5/users/93766644885748339cc4a070e282052a/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.486670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0063b207a684478c82ce3efbdf46a3b5, user_id=93766644885748339cc4a070e282052a, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:17.489481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:17.575032 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1331/2631] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:17 2022] PUT /identity/v3/projects/0063b207a684478c82ce3efbdf46a3b5/users/93766644885748339cc4a070e282052a/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:17.579023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:17.589736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d0264-6ecb-43b7-8471-fba24bd16345 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:17.649380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa28aa2-4f23-42a5-b2c1-f2bff57cf6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:17.650040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa28aa2-4f23-42a5-b2c1-f2bff57cf6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.650322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa28aa2-4f23-42a5-b2c1-f2bff57cf6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.650589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa28aa2-4f23-42a5-b2c1-f2bff57cf6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.651300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa28aa2-4f23-42a5-b2c1-f2bff57cf6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:17.652914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa28aa2-4f23-42a5-b2c1-f2bff57cf6d7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:17.662489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1301/2632] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:17.666677 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:17.676987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529e54-0065-4a26-8033-53aeee4a86c1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:17.681713 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:17.682626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:17.682908 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:17.683185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] PATH_INFO: `/v3/projects/0063b207a684478c82ce3efbdf46a3b5/users/93766644885748339cc4a070e282052a/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:17.685176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0063b207a684478c82ce3efbdf46a3b5, user_id=93766644885748339cc4a070e282052a, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:17.687819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:17.698450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1332/2633] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:17 2022] PUT /identity/v3/projects/0063b207a684478c82ce3efbdf46a3b5/users/93766644885748339cc4a070e282052a/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:19.073955 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:19.074508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:19.074508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:19.106840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] MFA Rules not processed for user `93766644885748339cc4a070e282052a`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:19.108268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:19.186069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1302/2634] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:19.196059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:19.197740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:19.255848 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810ace-82c1-49a2-934b-ef3314f5484c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:19.260056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa570da-3c9f-4aba-999c-71ed3a9c62e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:19.260750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa570da-3c9f-4aba-999c-71ed3a9c62e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:19.261297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa570da-3c9f-4aba-999c-71ed3a9c62e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:19.261583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa570da-3c9f-4aba-999c-71ed3a9c62e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:19.317565 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa570da-3c9f-4aba-999c-71ed3a9c62e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:19.319049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa570da-3c9f-4aba-999c-71ed3a9c62e0 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:19.327823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1333/2635] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:22.049396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:22.059336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b7ce-ad8c-4d6a-b775-fb800da946e3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:22.062899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:22.063520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:22.063796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:22.064066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:22.072644 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:22.074049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:22.083398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1303/2636] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:41.091042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.091607 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.091732 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.109124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] MFA Rules not processed for user `fa4b889b3aff47cea0a0d254870515cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:41.110336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:41.162857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1334/2637] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:41.200699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:41.210148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a56be-b416-4686-b53e-1ad165d20a56 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:41.218426 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:41.218996 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.219348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.219691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.221603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:41.304559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:41.304559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:41.308072 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1304/2638] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:41.663271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:41.726914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add823e0-30b8-4774-954c-2500bea4cfbb None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:41.732325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:41.733241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:41.733524 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:41.733799 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] PATH_INFO: `/v3/users/213f01df87d04ad5bae09859531f680e` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:41.734986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=213f01df87d04ad5bae09859531f680e)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:41.736984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:41.902946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213f01df87d04ad5bae09859531f680e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.909999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213f01df87d04ad5bae09859531f680e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:41.924728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213f01df87d04ad5bae09859531f680e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.002095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213f01df87d04ad5bae09859531f680e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.002717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213f01df87d04ad5bae09859531f680e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.009202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1335/2639] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:41 2022] DELETE /identity/v3/users/213f01df87d04ad5bae09859531f680e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:42.251026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.262505 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7ba7-2f50-4360-94ef-dc8b49c95b89 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.319037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.323401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.323401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.323401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] PATH_INFO: `/v3/projects/6b2c161e9f0b4b4ea42fdb52ad3617d3` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.323401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2c161e9f0b4b4ea42fdb52ad3617d3)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.324073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.412805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.414420 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.437747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2c161e9f0b4b4ea42fdb52ad3617d3', 'request_id': 'req-8cb326ca-c535-4148-aba6-ddde9db015db'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.443839 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2c161e9f0b4b4ea42fdb52ad3617d3', 'request_id': 'req-8cb326ca-c535-4148-aba6-ddde9db015db'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.449817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2c161e9f0b4b4ea42fdb52ad3617d3', 'request_id': 'req-8cb326ca-c535-4148-aba6-ddde9db015db'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.482666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445067-dc98-4d4d-956d-ec32530d68ae admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.493336 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] The token cache is being invalidate because project 6b2c161e9f0b4b4ea42fdb52ad3617d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:42.493560 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.494205 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.496936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1305/2640] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:42 2022] DELETE /identity/v3/projects/6b2c161e9f0b4b4ea42fdb52ad3617d3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:42.500833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.500833 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.544750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.549806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.549806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.549806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.549806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.554751 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb326ca-c535-4148-aba6-ddde9db015db admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.559216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.559533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.559855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.560137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.560411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.561308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.562242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.571505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1336/2641] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:42.572301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:42.573966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:42.633738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.635216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.642220 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca63f-9d4e-4f08-87f6-ff24391e401d service placement] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:42.647243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:42.647420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1306/2642] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:42.647961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:42.648505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:42.648878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] PATH_INFO: `/v3/users/93766644885748339cc4a070e282052a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:42.650146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=93766644885748339cc4a070e282052a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:42.652138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:42.821905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93766644885748339cc4a070e282052a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.828482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93766644885748339cc4a070e282052a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.839962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93766644885748339cc4a070e282052a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.950504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93766644885748339cc4a070e282052a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.951139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-64068828-24c3-4b57-9ed8-196aebd47fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93766644885748339cc4a070e282052a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:42.957449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1337/2643] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:42 2022] DELETE /identity/v3/users/93766644885748339cc4a070e282052a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:43.194837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.204191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c7dab-3643-40f8-9fd0-8ac1c980af59 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.262139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.263150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.263418 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.263804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] PATH_INFO: `/v3/projects/0063b207a684478c82ce3efbdf46a3b5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.265026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0063b207a684478c82ce3efbdf46a3b5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.266925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.414551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0063b207a684478c82ce3efbdf46a3b5', 'request_id': 'req-b84c1118-42e5-411d-828e-054f8232e965'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:43.420533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0063b207a684478c82ce3efbdf46a3b5', 'request_id': 'req-b84c1118-42e5-411d-828e-054f8232e965'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:43.425747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0063b207a684478c82ce3efbdf46a3b5', 'request_id': 'req-b84c1118-42e5-411d-828e-054f8232e965'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:43.476949 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] The token cache is being invalidate because project 0063b207a684478c82ce3efbdf46a3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:43.477237 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:43.477882 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-b84c1118-42e5-411d-828e-054f8232e965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:43.479470 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1307/2644] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:43 2022] DELETE /identity/v3/projects/0063b207a684478c82ce3efbdf46a3b5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:43.484377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.484857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.484971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.502581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:43.503802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:43.563389 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1338/2645] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:43.571270 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.571566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.571842 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.590930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:43.592187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:43.600207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1308/2646] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:43.604443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.615008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e7100-8888-4693-b974-75d50103ecd6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.618751 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.619406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.619693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.619970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.620723 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:43.621153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.622872 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.635962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1339/2647] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:43.639903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.649150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f957c-4d7d-4a6a-978b-75b38559d7ed None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.654455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.655113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.655399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.655675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.656356 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.658298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.739404 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1309/2648] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:43 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:43.740668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.752404 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea878a16-3bdf-41c0-8579-2b43bbf8273a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.810823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.811493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.811777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.812054 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.812771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.814704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.892027 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1340/2649] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:43 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:43.893338 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.903561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb3cf6-234b-4668-b545-bc0b125e84ea admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.908295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.909048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.909333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.909640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.910367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.911983 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.922416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1310/2650] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:43.926544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.936802 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdf3d-d2c9-481b-809b-d79d56cba64f admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.941395 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bcc20-3125-4fd3-a104-26a1be463ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.942041 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bcc20-3125-4fd3-a104-26a1be463ece admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.942325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bcc20-3125-4fd3-a104-26a1be463ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.942600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bcc20-3125-4fd3-a104-26a1be463ece admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.943322 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bcc20-3125-4fd3-a104-26a1be463ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.944975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bcc20-3125-4fd3-a104-26a1be463ece admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:43.955511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1341/2651] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:43.959175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:43.969040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95b77-b5c9-47fe-8b9b-c23856dd21a1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:43.973821 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:43.974686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:43.974970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:43.975254 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] PATH_INFO: `/v3/projects/f7b5055aa78a4c0c83f7d8d23a8dd577/users/b4b72d8c0e954ff994e40d194d30ece8/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:43.993670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b5055aa78a4c0c83f7d8d23a8dd577, user_id=b4b72d8c0e954ff994e40d194d30ece8, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:43.998399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.088992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1311/2652] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:43 2022] PUT /identity/v3/projects/f7b5055aa78a4c0c83f7d8d23a8dd577/users/b4b72d8c0e954ff994e40d194d30ece8/roles/246514336b4549609174329cae41663a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:44.099905 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.101380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.101380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.128790 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] MFA Rules not processed for user `b4b72d8c0e954ff994e40d194d30ece8`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:44.129994 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:44.190972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1342/2653] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:44.195373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.254173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287028-a56c-4279-8019-499f574ce754 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.258848 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.259497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.259779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.260594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.261587 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.263497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.350516 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1312/2654] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:44.351690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.362494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb03cf-1b38-47c7-a118-2c9911296fea None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.419295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.419969 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.420254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.420580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.421259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.423188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.522567 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1343/2655] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:44.526970 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.536738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aeba8-e366-42c1-bcb0-76989e60cffe admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.541930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.547272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.547272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.547272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.547272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.547272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.556511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1313/2656] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:44.560592 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.571864 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ab52-3347-4390-8b0d-9578c67f1667 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.577481 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2c65-b449-4a64-8560-cab6d9bee2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.578341 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2c65-b449-4a64-8560-cab6d9bee2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.578638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2c65-b449-4a64-8560-cab6d9bee2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.578920 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2c65-b449-4a64-8560-cab6d9bee2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.579801 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2c65-b449-4a64-8560-cab6d9bee2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.582042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2c65-b449-4a64-8560-cab6d9bee2d9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.595034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1344/2657] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:44.601614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.613380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc3c00-56df-4cee-adce-b85fb8d2dfca admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.621756 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.623361 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.623876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.624381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] PATH_INFO: `/v3/projects/431731e6edfa47238b1d32e1eebd1c75/users/0ba9154fa15f4cf8bf8de4aebd741a77/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.640894 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431731e6edfa47238b1d32e1eebd1c75, user_id=0ba9154fa15f4cf8bf8de4aebd741a77, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.643808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:44.746552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1314/2658] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:44 2022] PUT /identity/v3/projects/431731e6edfa47238b1d32e1eebd1c75/users/0ba9154fa15f4cf8bf8de4aebd741a77/roles/246514336b4549609174329cae41663a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:44.756863 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.757160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.757441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.785977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] MFA Rules not processed for user `0ba9154fa15f4cf8bf8de4aebd741a77`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:44.787208 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:44.855546 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1345/2659] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:44.859795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:44.928563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3ed2-ffbd-41a6-a0f4-a5cdab23e1f2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:44.933563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:44.934225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:44.934511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:44.934790 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:44.935479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:44.937421 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.050694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1315/2660] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:44 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:45.054720 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.066870 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35bb5a-55c0-4504-b64a-5f647f80bcb6 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.124743 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.125431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.125714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.125992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.126704 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.128812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.192151 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1346/2661] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:45 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:45.196466 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.208891 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d447e52-eb6f-4099-a98f-0fcac4c4e3b4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.214395 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.215082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.215364 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.215642 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.216375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.218012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.230234 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1316/2662] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:45.234583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.245106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6081-46e7-4450-8699-601d19396308 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.250106 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.251088 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.251376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.251653 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] PATH_INFO: `/v3/projects/784caf45fce04bdab90a9642f38ed1c6/users/a22d42f4b6874044a66593ed271f78fb/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.267247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=784caf45fce04bdab90a9642f38ed1c6, user_id=a22d42f4b6874044a66593ed271f78fb, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.270006 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.346783 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1347/2663] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:45 2022] PUT /identity/v3/projects/784caf45fce04bdab90a9642f38ed1c6/users/a22d42f4b6874044a66593ed271f78fb/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:45.351067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.361739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7313ed5-f12c-481b-bc2c-aaa5e86b27f5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.418721 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3263aad-1723-499d-8636-0e348d2a7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.419437 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3263aad-1723-499d-8636-0e348d2a7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.419865 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3263aad-1723-499d-8636-0e348d2a7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.420101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3263aad-1723-499d-8636-0e348d2a7fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.420881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3263aad-1723-499d-8636-0e348d2a7fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.422464 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3263aad-1723-499d-8636-0e348d2a7fa2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.432246 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1317/2664] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:45.436534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.446924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d575f-5ccd-4b1d-8150-c1e531254bde admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.451644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.452555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.452839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.453119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] PATH_INFO: `/v3/projects/784caf45fce04bdab90a9642f38ed1c6/users/a22d42f4b6874044a66593ed271f78fb/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.455137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=784caf45fce04bdab90a9642f38ed1c6, user_id=a22d42f4b6874044a66593ed271f78fb, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.458243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.469486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1348/2665] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:45 2022] PUT /identity/v3/projects/784caf45fce04bdab90a9642f38ed1c6/users/a22d42f4b6874044a66593ed271f78fb/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:45.480244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.480565 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.480870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.507348 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] MFA Rules not processed for user `a22d42f4b6874044a66593ed271f78fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:45.508602 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:45.588840 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1318/2666] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:45.604491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.604491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:45.676615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9358d0-1d15-448d-a8b1-9dcf4c7548fe admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.680499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.681231 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.681579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.681952 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.745669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.749551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.758061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1349/2667] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:45.774739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:45.776380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:45.841114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8250-d135-4acd-b332-12bc28626316 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:45.841114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:45.841482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:45.841758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:45.842037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:45.843964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:45.854261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:45.855758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:45.863814 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1319/2668] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:46.781702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:46.783728 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:46.867282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3749e0d-85bc-4adc-b000-848ac0136a59 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:46.873531 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:46.874198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:46.874494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:46.874747 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:46.876583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:46.890767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:46.892332 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:46.906935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1350/2669] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:47.080106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:47.089655 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09fe07-95bb-42d6-bf64-dc2c8163ffbb service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:47.093209 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:47.093841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:47.094122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:47.094398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:47.096161 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:47.173785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:47.175275 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:47.193514 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1320/2670] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:47.796941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:47.798597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:47.810734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb234ad-2fe5-49b5-b918-5d3cecdd105c service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:47.814399 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:47.815038 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:47.815346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:47.815624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:47.870775 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:47.872227 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:47.881181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1351/2671] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:49.129950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:49.138947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56919-4d89-4719-b706-0e9e626a5e1f service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:49.144006 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87be3e3-038f-4da8-b651-9a47f71df6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:49.146088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87be3e3-038f-4da8-b651-9a47f71df6af service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:49.146088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87be3e3-038f-4da8-b651-9a47f71df6af service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:49.146088 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87be3e3-038f-4da8-b651-9a47f71df6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:49.155475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87be3e3-038f-4da8-b651-9a47f71df6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:49.156993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87be3e3-038f-4da8-b651-9a47f71df6af service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:49.166931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1321/2672] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:53.933975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:53.993763 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12958f06-0887-4cb3-bb44-f1410dc7122c service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:53.998968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:53.999819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:54.000099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:54.000369 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] PATH_INFO: `/v3/users/b4b72d8c0e954ff994e40d194d30ece8` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.001575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b72d8c0e954ff994e40d194d30ece8)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:54.003612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:54.192491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b72d8c0e954ff994e40d194d30ece8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:54.199026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b72d8c0e954ff994e40d194d30ece8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:54.210430 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b72d8c0e954ff994e40d194d30ece8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:54.294664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b72d8c0e954ff994e40d194d30ece8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:54.295294 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b72d8c0e954ff994e40d194d30ece8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:54.301993 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1352/2673] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:53 2022] DELETE /identity/v3/users/b4b72d8c0e954ff994e40d194d30ece8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:54.306647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:54.307216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:54.307320 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.324306 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:54.325535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:54.382985 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1322/2674] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:42:54.393261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:54.395462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:54.451432 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda943-2380-4f02-897b-b1df6f3d42d8 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:54.455403 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:54.456044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:54.456326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:54.456686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.467188 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:54.468661 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:54.478519 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1353/2675] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:54.923650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:54.926436 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:54.942406 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c9bb-45f7-4250-9d6d-07cc690b9b96 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:54.957950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:54.958826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:54.959109 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:54.959398 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] PATH_INFO: `/v3/projects/f7b5055aa78a4c0c83f7d8d23a8dd577` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:54.960709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b5055aa78a4c0c83f7d8d23a8dd577)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:54.962593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:55.036186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:55.045407 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1fd1-e6a0-4896-ac9f-bec532dbac27 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:55.049256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:55.049927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:55.050211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:55.050486 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:55.052374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:55.065737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:55.067203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:55.078522 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1354/2676] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:42:55.214986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b5055aa78a4c0c83f7d8d23a8dd577', 'request_id': 'req-c5f81fcc-9da3-4f0a-9d36-f4c923805300'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.222281 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b5055aa78a4c0c83f7d8d23a8dd577', 'request_id': 'req-c5f81fcc-9da3-4f0a-9d36-f4c923805300'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.228412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b5055aa78a4c0c83f7d8d23a8dd577', 'request_id': 'req-c5f81fcc-9da3-4f0a-9d36-f4c923805300'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.314435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] The token cache is being invalidate because project f7b5055aa78a4c0c83f7d8d23a8dd577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:55.315115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.316035 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.317727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1323/2677] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:54 2022] DELETE /identity/v3/projects/f7b5055aa78a4c0c83f7d8d23a8dd577 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:55.321673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:55.331226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3c8c3-bcc4-4e39-88c6-f934114e011a service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:55.386563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:55.387454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:55.387738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:55.388016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] PATH_INFO: `/v3/users/0ba9154fa15f4cf8bf8de4aebd741a77` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:55.389261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba9154fa15f4cf8bf8de4aebd741a77)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:55.391194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:55.589037 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba9154fa15f4cf8bf8de4aebd741a77'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.599189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba9154fa15f4cf8bf8de4aebd741a77'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.617049 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba9154fa15f4cf8bf8de4aebd741a77'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.699669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba9154fa15f4cf8bf8de4aebd741a77'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.700292 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba9154fa15f4cf8bf8de4aebd741a77'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:55.707835 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1355/2678] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:55 2022] DELETE /identity/v3/users/0ba9154fa15f4cf8bf8de4aebd741a77 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:56.127969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:56.129429 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:56.149212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f81fcc-9da3-4f0a-9d36-f4c923805300 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:56.207836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:56.209080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:56.209256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:56.209536 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] PATH_INFO: `/v3/projects/431731e6edfa47238b1d32e1eebd1c75` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:56.210771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431731e6edfa47238b1d32e1eebd1c75)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:56.212714 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:56.323943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431731e6edfa47238b1d32e1eebd1c75', 'request_id': 'req-84495cb5-b979-4fd0-ab82-0c48d85a8418'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.330717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431731e6edfa47238b1d32e1eebd1c75', 'request_id': 'req-84495cb5-b979-4fd0-ab82-0c48d85a8418'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.336583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431731e6edfa47238b1d32e1eebd1c75', 'request_id': 'req-84495cb5-b979-4fd0-ab82-0c48d85a8418'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.425187 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] The token cache is being invalidate because project 431731e6edfa47238b1d32e1eebd1c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:56.425982 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.427476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.429303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1324/2679] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:56 2022] DELETE /identity/v3/projects/431731e6edfa47238b1d32e1eebd1c75 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:56.433466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:56.435044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:56.452312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d682d6-124e-40a7-b92e-fec44804954c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:56.531597 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:56.532581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:56.533043 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:56.533508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] PATH_INFO: `/v3/users/a22d42f4b6874044a66593ed271f78fb` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:56.535076 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22d42f4b6874044a66593ed271f78fb)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:56.537742 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:56.724652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22d42f4b6874044a66593ed271f78fb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.732124 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22d42f4b6874044a66593ed271f78fb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.744482 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22d42f4b6874044a66593ed271f78fb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.818812 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22d42f4b6874044a66593ed271f78fb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.819462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fdfad2a6-1dae-4b72-911c-0d229be5b301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22d42f4b6874044a66593ed271f78fb'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:56.826523 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1356/2680] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:56 2022] DELETE /identity/v3/users/a22d42f4b6874044a66593ed271f78fb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:57.410917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:57.412456 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:57.425410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84495cb5-b979-4fd0-ab82-0c48d85a8418 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:57.484881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:57.485747 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:57.486030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:57.486307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] PATH_INFO: `/v3/projects/784caf45fce04bdab90a9642f38ed1c6` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:57.487504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] RBAC: Authorizing `identity:delete_project(project_id=784caf45fce04bdab90a9642f38ed1c6)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:57.489629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:57.591709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784caf45fce04bdab90a9642f38ed1c6', 'request_id': 'req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:57.598125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784caf45fce04bdab90a9642f38ed1c6', 'request_id': 'req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:57.604401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784caf45fce04bdab90a9642f38ed1c6', 'request_id': 'req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:57.690630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] The token cache is being invalidate because project 784caf45fce04bdab90a9642f38ed1c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:42:57.691717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:57.692600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-ca48e1e1-11dd-4774-9ac9-2f305d5f56df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:57.695485 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1325/2681] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:57 2022] DELETE /identity/v3/projects/784caf45fce04bdab90a9642f38ed1c6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:57.700942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:57.702105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:57.702599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:57.721692 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:57.722934 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:57.779695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1357/2682] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:57.787462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:57.787752 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:57.788034 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:57.808409 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:57.809658 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:57.817671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1326/2683] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:57.828091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:57.838575 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e62ad-a601-4674-92f2-a01c6789f22a None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:57.844314 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:57.845025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:57.845312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:57.845593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:57.846324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:42:57.846631 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:57.848249 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:57.864256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1358/2684] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:42:57.866075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:57.877501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e122-6001-4e96-9ce3-d4c13a738469 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:57.882764 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:57.882881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:57.883160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:57.883428 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:57.884111 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:57.886128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:57.981834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1327/2685] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:57 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:57.982642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:57.996460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb8c47-11b4-405c-8281-615ebac4a294 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:58.099444 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:58.100133 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.100779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.101058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.101759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:58.104297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:58.234398 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1359/2686] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:57 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:42:58.240870 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:58.253135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55547b-d101-4e11-8b72-cd19ca30d733 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:58.260204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:58.260988 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.266645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.266645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.266645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:58.266645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:58.277446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1328/2687] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:58.282485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:58.293914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d98b-4b68-42b4-b49f-954e848fad66 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:58.301508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247fd39-e6e4-4bd2-9904-6fb3df4a2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:58.302324 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fd39-e6e4-4bd2-9904-6fb3df4a2520 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.302894 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fd39-e6e4-4bd2-9904-6fb3df4a2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.303339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fd39-e6e4-4bd2-9904-6fb3df4a2520 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.304136 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247fd39-e6e4-4bd2-9904-6fb3df4a2520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:58.305978 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247fd39-e6e4-4bd2-9904-6fb3df4a2520 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:58.328641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1360/2688] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:58.329673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:58.341698 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b0053-345f-4625-904f-c429aa772132 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:58.348820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:58.350207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.350841 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.356390 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] PATH_INFO: `/v3/projects/332f466e60224f7aa893bc4689307cbd/users/f56c348d53444121a18dc0cf4b5aab9b/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.369150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332f466e60224f7aa893bc4689307cbd, user_id=f56c348d53444121a18dc0cf4b5aab9b, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:58.373614 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:58.459671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1329/2689] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:58 2022] PUT /identity/v3/projects/332f466e60224f7aa893bc4689307cbd/users/f56c348d53444121a18dc0cf4b5aab9b/roles/246514336b4549609174329cae41663a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:58.474907 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.475291 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.475678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.511912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] MFA Rules not processed for user `f56c348d53444121a18dc0cf4b5aab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:58.513190 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:58.596840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1361/2690] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:58.601449 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:58.678758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2141-a8d6-4c40-875d-658249d3fb67 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:58.691740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:58.692620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.693023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.693391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.694695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:58.696727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:58.790479 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1330/2691] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:58 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:58.795003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:58.808361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ce09-6c5d-453a-941a-b7fb304d0968 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:58.899330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:58.900084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:58.900490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:58.901126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:58.901918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:58.904039 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:58.987686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1362/2692] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:58 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:58.989435 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.000027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d384-e842-4752-b6ac-a991148ea010 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.004980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.005668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.005952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.006228 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.007831 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.008635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.020303 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1331/2693] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:42:59.024579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.034583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8006a9-68f4-43b9-bdb5-50cd4ddedc6b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.039138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d18d-9319-4245-a12e-2ac3f05d8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.039791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d18d-9319-4245-a12e-2ac3f05d8491 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.040065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d18d-9319-4245-a12e-2ac3f05d8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.040338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d18d-9319-4245-a12e-2ac3f05d8491 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.041623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d18d-9319-4245-a12e-2ac3f05d8491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.043213 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d18d-9319-4245-a12e-2ac3f05d8491 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.054320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1363/2694] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:59.061509 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.072490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ba4f-ee18-4787-ae31-9a27cdd07bd9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.081934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.082872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.083219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.083528 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] PATH_INFO: `/v3/projects/1a61179336bf44cb9f0cd6290f84890b/users/bf6b6e9f62454855a17a32c387521db5/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.104022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a61179336bf44cb9f0cd6290f84890b, user_id=bf6b6e9f62454855a17a32c387521db5, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.107097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.190670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1332/2695] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:59 2022] PUT /identity/v3/projects/1a61179336bf44cb9f0cd6290f84890b/users/bf6b6e9f62454855a17a32c387521db5/roles/246514336b4549609174329cae41663a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:59.206706 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.207004 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.207289 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.234622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] MFA Rules not processed for user `bf6b6e9f62454855a17a32c387521db5`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:42:59.235881 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:59.308598 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1364/2696] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:42:59.317103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.377881 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378be0-d887-4d3e-ae20-71f994c586b9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.381482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.382132 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.382415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.382689 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.383372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.385400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.411466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.413048 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:59.427270 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8c437-dc8d-4b35-bed2-cc8c67df5ae2 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.432007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.435476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.435476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.435476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] PATH_INFO: `/v3/users/ab38a084fbb643298d38c4cd8dcf87cd` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.435476 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab38a084fbb643298d38c4cd8dcf87cd)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.436630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.485286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1333/2697] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:42:59 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:59.489215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.551215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c25c57-a1b0-42da-86d3-3a650a27db32 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.557532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.558199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.558504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.558776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.559461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.561399 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.644796 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1334/2698] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:42:59 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:42:59.648849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab38a084fbb643298d38c4cd8dcf87cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:59.649634 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.657108 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab38a084fbb643298d38c4cd8dcf87cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:59.659924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b7ce3-8009-441b-b486-bb13095d5f63 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.664583 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.665232 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.665508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.666388 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.667110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.668695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.670221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab38a084fbb643298d38c4cd8dcf87cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:59.678616 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1335/2699] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:59.682864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.692286 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4abdf7-b43f-480c-b06d-2e331469ccc5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.697268 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.698122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.702666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.702666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] PATH_INFO: `/v3/projects/6f19889005ae49468b2eee9ac80f907c/users/b3066ffe4e3c4f7c89656e38feb5e76d/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.713304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f19889005ae49468b2eee9ac80f907c, user_id=b3066ffe4e3c4f7c89656e38feb5e76d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.715935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.721309 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab38a084fbb643298d38c4cd8dcf87cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:59.721973 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab38a084fbb643298d38c4cd8dcf87cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:42:59.728158 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1365/2700] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:42:59 2022] DELETE /identity/v3/users/ab38a084fbb643298d38c4cd8dcf87cd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:59.780792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1336/2701] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:59 2022] PUT /identity/v3/projects/6f19889005ae49468b2eee9ac80f907c/users/b3066ffe4e3c4f7c89656e38feb5e76d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:42:59.785627 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.787120 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:42:59.862020 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602f71-625c-44e9-8825-a0858e4ee459 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.924655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a2409-18a4-4c3f-8dfd-be8aea58f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.925422 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a2409-18a4-4c3f-8dfd-be8aea58f368 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.925711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a2409-18a4-4c3f-8dfd-be8aea58f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.925992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a2409-18a4-4c3f-8dfd-be8aea58f368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.926724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a2409-18a4-4c3f-8dfd-be8aea58f368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.928336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a2409-18a4-4c3f-8dfd-be8aea58f368 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.938154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1366/2702] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:42:59.942405 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:59.952724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7164-0ada-489e-ac17-db277a33d5b5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:59.957148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:59.958038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.958310 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.958576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] PATH_INFO: `/v3/projects/6f19889005ae49468b2eee9ac80f907c/users/b3066ffe4e3c4f7c89656e38feb5e76d/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.960527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f19889005ae49468b2eee9ac80f907c, user_id=b3066ffe4e3c4f7c89656e38feb5e76d, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:59.963781 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:59.973687 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1337/2703] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:42:59 2022] PUT /identity/v3/projects/6f19889005ae49468b2eee9ac80f907c/users/b3066ffe4e3c4f7c89656e38feb5e76d/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:42:59.983568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:59.983903 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:59.984200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:59.998734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.000531 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.018138 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] MFA Rules not processed for user `b3066ffe4e3c4f7c89656e38feb5e76d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:00.019480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.082962 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177818-8554-47fb-9dc0-c41392eb24d4 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.088624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.089772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.092225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.092225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] PATH_INFO: `/v3/projects/d3acaa73503748ac9764a7eca8943882` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.092225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3acaa73503748ac9764a7eca8943882)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.094062 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1367/2704] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:00.096504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.104221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.105590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.162833 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531eb33-3b52-4667-8fb2-f0166183ad1b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.166532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.167219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.167499 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.167778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.169619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.202835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3acaa73503748ac9764a7eca8943882', 'request_id': 'req-a17470cf-33ab-49a4-8d3e-643e40993954'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:00.208792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3acaa73503748ac9764a7eca8943882', 'request_id': 'req-a17470cf-33ab-49a4-8d3e-643e40993954'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:00.214411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3acaa73503748ac9764a7eca8943882', 'request_id': 'req-a17470cf-33ab-49a4-8d3e-643e40993954'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:00.228011 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.229505 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8d85-c764-489c-b69f-c55b34fbed8c service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.238512 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1368/2705] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:00.312451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] The token cache is being invalidate because project d3acaa73503748ac9764a7eca8943882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:00.312720 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:00.313358 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-a17470cf-33ab-49a4-8d3e-643e40993954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:00.314987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1338/2706] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:42:59 2022] DELETE /identity/v3/projects/d3acaa73503748ac9764a7eca8943882 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:00.320091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.320385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.320697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.339620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:00.340987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.399388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1369/2707] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:00.407156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.407445 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.407717 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.426795 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:00.427889 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:00.436198 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1339/2708] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:00.440525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.451377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3104f2-d3a2-4f89-a177-bb706c440f54 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.456199 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.456885 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.457168 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.457444 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.458157 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:00.458539 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.460166 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.473320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1370/2709] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:00.477294 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.486993 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6d6f-7fe0-42ca-b51f-717314f1ac84 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.491692 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.492327 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.492637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.492974 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.493666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.495623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.586931 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1340/2710] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:00 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:00.591917 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.602202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b627028-6822-4362-9f8d-a7f5f1098653 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.658431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.659064 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.659338 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.659618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.660323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.662316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.761644 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1371/2711] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:00 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:00.763243 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.773482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ee821-ebad-4b9d-8b1c-f09f1eca1bc2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.779174 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.779947 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.780330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.780753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.781576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.783416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.801748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1341/2712] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:00.805724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.818583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab5e33-712d-49cc-b312-911681a88706 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.824010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a779683-96c0-42c3-a2f9-e7c60882c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.824707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779683-96c0-42c3-a2f9-e7c60882c385 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.824995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779683-96c0-42c3-a2f9-e7c60882c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.825273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779683-96c0-42c3-a2f9-e7c60882c385 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.826000 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a779683-96c0-42c3-a2f9-e7c60882c385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.827599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a779683-96c0-42c3-a2f9-e7c60882c385 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.839091 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1372/2713] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:00.846047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:00.855802 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a727e-842e-4a5f-ac16-af9946fd3d8b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:00.860852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:00.862077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.862700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.863193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] PATH_INFO: `/v3/projects/ab0f3f48f5a245cca1df64e5f5e1c413/users/09deded74f144b4da811dfbb1f9691f7/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:00.881691 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0f3f48f5a245cca1df64e5f5e1c413, user_id=09deded74f144b4da811dfbb1f9691f7, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:00.885113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:00.974741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1342/2714] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:00 2022] PUT /identity/v3/projects/ab0f3f48f5a245cca1df64e5f5e1c413/users/09deded74f144b4da811dfbb1f9691f7/roles/246514336b4549609174329cae41663a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:00.986857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:00.987323 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:00.987437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:01.019102 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:01.019267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] MFA Rules not processed for user `09deded74f144b4da811dfbb1f9691f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:01.020447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:01.020784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:01.076507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433f979-f875-4f99-8503-425521c5557c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:01.080156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:01.080823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:01.081104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:01.081386 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:01.082946 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1373/2715] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:01.083245 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:01.093771 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:01.095321 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:01.146331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:01.147791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:01.157260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1343/2716] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:01.170451 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba964d-880e-4421-b77a-b51916d86b4c None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:01.175936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:01.176605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:01.176882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:01.177152 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:01.185418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:01.187210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:01.195737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1374/2717] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:02.120541 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:02.122175 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.181242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e57d-2403-42bf-b01b-61b97e734af3 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:02.186668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:02.186668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:02.186668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:02.186668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:02.187991 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:02.246073 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:02.247596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:02.256239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1344/2718] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:04.156061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:04.165548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928154cd-cd7b-4260-9fbf-f60d978f6bc3 service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:04.169670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:04.170413 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:04.170762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:04.171127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:04.173044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:04.252271 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:04.253839 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c68c6-1352-4a59-bb7a-dc1215b663ad service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:04.265629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1375/2719] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:10.667012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:10.728271 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba65e3-b640-411b-99b2-4912b0b666b1 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:10.732861 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:10.733556 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:10.733837 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:10.734117 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] PATH_INFO: `/v3/users/09deded74f144b4da811dfbb1f9691f7` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:10.735298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09deded74f144b4da811dfbb1f9691f7)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:10.737227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:10.958665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09deded74f144b4da811dfbb1f9691f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.959359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09deded74f144b4da811dfbb1f9691f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.966715 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09deded74f144b4da811dfbb1f9691f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.978047 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09deded74f144b4da811dfbb1f9691f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:10.978741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09deded74f144b4da811dfbb1f9691f7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.042487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1345/2720] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:10 2022] DELETE /identity/v3/users/09deded74f144b4da811dfbb1f9691f7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:11.047017 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.047479 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.047663 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.065119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:11.066293 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.123364 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1376/2721] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:11.133116 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.134531 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.189454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac9ee-c648-475a-be2f-ba4c03af229d admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:11.193251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b19fea-9cc6-4a86-b848-e9f8e68b6611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:11.193883 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19fea-9cc6-4a86-b848-e9f8e68b6611 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.194162 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19fea-9cc6-4a86-b848-e9f8e68b6611 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.194432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19fea-9cc6-4a86-b848-e9f8e68b6611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.203110 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19fea-9cc6-4a86-b848-e9f8e68b6611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:11.204549 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19fea-9cc6-4a86-b848-e9f8e68b6611 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:11.214036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1346/2722] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:11.688852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.688852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.688852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92edb02-a8a9-423d-b473-a9d5f81595f4 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:11.689621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:11.689621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.689621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.689621 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] PATH_INFO: `/v3/projects/ab0f3f48f5a245cca1df64e5f5e1c413` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.690411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0f3f48f5a245cca1df64e5f5e1c413)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:11.690411 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:11.785867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0f3f48f5a245cca1df64e5f5e1c413', 'request_id': 'req-63374c55-deb7-4191-b527-eab0fb9ddc6a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.846739 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0f3f48f5a245cca1df64e5f5e1c413', 'request_id': 'req-63374c55-deb7-4191-b527-eab0fb9ddc6a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.852982 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0f3f48f5a245cca1df64e5f5e1c413', 'request_id': 'req-63374c55-deb7-4191-b527-eab0fb9ddc6a'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.862984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] The token cache is being invalidate because project ab0f3f48f5a245cca1df64e5f5e1c413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:11.863267 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.863890 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-63374c55-deb7-4191-b527-eab0fb9ddc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:11.865455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1377/2723] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:11 2022] DELETE /identity/v3/projects/ab0f3f48f5a245cca1df64e5f5e1c413 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:11.870423 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.871022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.871022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.888973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:11.890152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.945810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1347/2724] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:11.954028 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127b19-989c-41b1-87ae-237519196643 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:11.954390 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127b19-989c-41b1-87ae-237519196643 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:11.954591 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127b19-989c-41b1-87ae-237519196643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:11.973622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ca127b19-989c-41b1-87ae-237519196643 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:11.974854 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ca127b19-989c-41b1-87ae-237519196643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:11.983489 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1378/2725] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:11.987817 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:11.997251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e80ad5-fead-4a63-b58a-5437591f3c4e None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.005664 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.007030 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.007654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.008339 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.009810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:12.010124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.011977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.025416 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1348/2726] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:12.026306 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127b19-989c-41b1-87ae-237519196643 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.027824 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ca127b19-989c-41b1-87ae-237519196643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.030355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.040114 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b836f-e5de-414d-83f7-da7ee0442c10 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.040374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127b19-989c-41b1-87ae-237519196643 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.044748 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.045026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.045365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.045650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.045879 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.045992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.046162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.046438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] PATH_INFO: `/v3/users/f56c348d53444121a18dc0cf4b5aab9b` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.046591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.047668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56c348d53444121a18dc0cf4b5aab9b)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.048501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.049648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.175599 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1349/2727] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:12.179678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.237412 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59865f9d-fb5b-4e08-9466-2092fdd98ac5 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.242287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.242971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.243250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.244127 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.244844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.246768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.273662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56c348d53444121a18dc0cf4b5aab9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.280362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56c348d53444121a18dc0cf4b5aab9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.296445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56c348d53444121a18dc0cf4b5aab9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.324290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1350/2728] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:12.328311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.337734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac152-628c-4801-835b-a71639fc1454 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.342322 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.345727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.345727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.345727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.345727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.345727 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.355439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1351/2729] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:12.358950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.367978 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503424-920a-4c5d-b8b2-e6eb01cdc950 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.373141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.373725 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.373997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.374266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.374376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56c348d53444121a18dc0cf4b5aab9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.374952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.375071 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cf25531d-0814-4b64-9a10-2a24a0854b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56c348d53444121a18dc0cf4b5aab9b'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:12.376487 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.381452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1379/2730] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:12 2022] DELETE /identity/v3/users/f56c348d53444121a18dc0cf4b5aab9b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:12.387067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1352/2731] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:12.390886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.391179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.391471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.391853 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.392584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.404420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dd397-3d9f-40b2-bfb3-52cdc4f971c8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.409063 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:12.410250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.457695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64fad-78e0-4afd-83e6-5a8cec68e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.458574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64fad-78e0-4afd-83e6-5a8cec68e124 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.458855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64fad-78e0-4afd-83e6-5a8cec68e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.459128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64fad-78e0-4afd-83e6-5a8cec68e124 admin admin] PATH_INFO: `/v3/projects/52277e5e29024460b10260f091a53323/users/a431621e59d4421d89ca7f9901e8929c/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.468256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1380/2732] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:12.473384 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64fad-78e0-4afd-83e6-5a8cec68e124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52277e5e29024460b10260f091a53323, user_id=a431621e59d4421d89ca7f9901e8929c, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.476059 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64fad-78e0-4afd-83e6-5a8cec68e124 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.477855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.479263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.528347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1353/2733] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:12 2022] PUT /identity/v3/projects/52277e5e29024460b10260f091a53323/users/a431621e59d4421d89ca7f9901e8929c/roles/246514336b4549609174329cae41663a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:12.534629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68d07a-bc21-4673-a601-89f142404a0e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.538244 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.538535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.538812 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.565134 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] MFA Rules not processed for user `a431621e59d4421d89ca7f9901e8929c`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:12.566331 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.583563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.584211 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.584525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.584808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.627629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1354/2734] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:12.644076 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.645469 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.646564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.648016 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.657626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1381/2735] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:12.718258 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e7b0-5212-462b-997f-54fc4be29653 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.724219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.729640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.729640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.729640 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.734046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.735809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:12.745227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1355/2736] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:12.928918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.938670 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039379-6742-44ea-84ab-4ee0e01bbda0 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.943417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.944272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.944583 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.944859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] PATH_INFO: `/v3/users/a431621e59d4421d89ca7f9901e8929c` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.946035 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a431621e59d4421d89ca7f9901e8929c)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:12.947984 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.069226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.069226 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.082341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af1725-3855-4fc6-9429-da6a9719c26a service nova] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.086914 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.088302 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.088626 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.088900 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] PATH_INFO: `/v3/projects/332f466e60224f7aa893bc4689307cbd` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.090265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] RBAC: Authorizing `identity:delete_project(project_id=332f466e60224f7aa893bc4689307cbd)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.092115 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.130047 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a431621e59d4421d89ca7f9901e8929c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.137083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a431621e59d4421d89ca7f9901e8929c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.148759 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a431621e59d4421d89ca7f9901e8929c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.185168 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332f466e60224f7aa893bc4689307cbd', 'request_id': 'req-c3c60aac-e3e6-4f2d-9684-172afd57155e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.191108 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332f466e60224f7aa893bc4689307cbd', 'request_id': 'req-c3c60aac-e3e6-4f2d-9684-172afd57155e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.196375 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332f466e60224f7aa893bc4689307cbd', 'request_id': 'req-c3c60aac-e3e6-4f2d-9684-172afd57155e'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.220127 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a431621e59d4421d89ca7f9901e8929c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.223940 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-ea6ab6ff-d037-4f7e-b56d-5a654d6f8ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a431621e59d4421d89ca7f9901e8929c'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.227287 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1382/2737] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:12 2022] DELETE /identity/v3/users/a431621e59d4421d89ca7f9901e8929c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:13.232316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.232649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.232935 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.249914 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:13.251102 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.299603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] The token cache is being invalidate because project 332f466e60224f7aa893bc4689307cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:13.299884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.300650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.304291 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1356/2738] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:13 2022] DELETE /identity/v3/projects/332f466e60224f7aa893bc4689307cbd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:13.306038 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.307316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.308173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1383/2739] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:13.317617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.318963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.371217 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60aac-e3e6-4f2d-9684-172afd57155e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.376210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.377154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.377431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.377699 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] PATH_INFO: `/v3/users/bf6b6e9f62454855a17a32c387521db5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.378944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6b6e9f62454855a17a32c387521db5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.380937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.506493 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf29b2-ebd1-490a-a279-d20c2cf59280 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.510673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.511308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.511841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.512113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.521782 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.523219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.533382 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1384/2740] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:13.575290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6b6e9f62454855a17a32c387521db5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.575887 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6b6e9f62454855a17a32c387521db5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.582507 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6b6e9f62454855a17a32c387521db5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.594574 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6b6e9f62454855a17a32c387521db5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.595290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6b6e9f62454855a17a32c387521db5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:13.659775 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1357/2741] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:13 2022] DELETE /identity/v3/users/bf6b6e9f62454855a17a32c387521db5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:13.912589 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.914029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.926327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd1755-8d68-4b2b-924c-fb1145a465b3 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.986469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.987330 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.987610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.987884 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] PATH_INFO: `/v3/projects/52277e5e29024460b10260f091a53323` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.989066 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52277e5e29024460b10260f091a53323)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.991130 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.075351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.076977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.090242 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0780cb-af54-4344-93d5-a7d70443dafd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.100256 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52277e5e29024460b10260f091a53323', 'request_id': 'req-a08012c0-ef97-4fc4-8ff2-613b450a33d8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.147472 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.148330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.148641 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.148911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] PATH_INFO: `/v3/projects/1a61179336bf44cb9f0cd6290f84890b` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.150070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a61179336bf44cb9f0cd6290f84890b)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.151973 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.167495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52277e5e29024460b10260f091a53323', 'request_id': 'req-a08012c0-ef97-4fc4-8ff2-613b450a33d8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.174098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52277e5e29024460b10260f091a53323', 'request_id': 'req-a08012c0-ef97-4fc4-8ff2-613b450a33d8'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.184976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] The token cache is being invalidate because project 52277e5e29024460b10260f091a53323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:14.185329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.186056 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-a08012c0-ef97-4fc4-8ff2-613b450a33d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.187734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1385/2742] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:13 2022] DELETE /identity/v3/projects/52277e5e29024460b10260f091a53323 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:14.192623 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5362e-f218-44fc-8492-efa782db166e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.192918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5362e-f218-44fc-8492-efa782db166e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.193198 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5362e-f218-44fc-8492-efa782db166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.210707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-a7f5362e-f218-44fc-8492-efa782db166e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:14.212040 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a7f5362e-f218-44fc-8492-efa782db166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.219948 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1386/2743] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:14.228836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.229618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.229899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.247710 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:14.248904 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.256683 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1387/2744] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:14.260744 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.269684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51661b4d-f391-42be-b2e7-ebe3f82dcb72 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.270018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a61179336bf44cb9f0cd6290f84890b', 'request_id': 'req-196c39d1-5746-4c7f-a2d9-df00cef083a7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.276213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a61179336bf44cb9f0cd6290f84890b', 'request_id': 'req-196c39d1-5746-4c7f-a2d9-df00cef083a7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.281635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a61179336bf44cb9f0cd6290f84890b', 'request_id': 'req-196c39d1-5746-4c7f-a2d9-df00cef083a7'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.323433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.324081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.324363 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.324669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.325379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:14.325694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.327273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.338471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1388/2745] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:43:14.343003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.352274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c2f2-6867-42fc-95f7-020675569771 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.357967 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.358590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.358871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.359146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.359819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.361753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.368133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] The token cache is being invalidate because project 1a61179336bf44cb9f0cd6290f84890b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:14.368443 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.369216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.371403 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1358/2746] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:14 2022] DELETE /identity/v3/projects/1a61179336bf44cb9f0cd6290f84890b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:14.375323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.376707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.388784 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c39d1-5746-4c7f-a2d9-df00cef083a7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.393417 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.394287 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.398647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.398647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] PATH_INFO: `/v3/users/b3066ffe4e3c4f7c89656e38feb5e76d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.398647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3066ffe4e3c4f7c89656e38feb5e76d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.398647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.444084 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1389/2747] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:14 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:14.448163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.449735 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.510236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1117f-2e7f-442e-932c-9fd609b7738d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.515226 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.515878 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.516160 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.516447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.517221 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.519137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.607333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1390/2748] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:14 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:14.611488 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.625727 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b50f1c-1d4a-4ec6-adb1-9644a85eb17c admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.625869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3066ffe4e3c4f7c89656e38feb5e76d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.625869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3066ffe4e3c4f7c89656e38feb5e76d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.626065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.626593 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.626871 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.627144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.627887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.629528 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.630381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3066ffe4e3c4f7c89656e38feb5e76d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.639913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1391/2749] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:14.644315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.648296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3066ffe4e3c4f7c89656e38feb5e76d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.651568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-5a8c873a-b5d3-45d1-b55b-3e79a3376d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3066ffe4e3c4f7c89656e38feb5e76d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:14.654862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e38a3-ed4b-4459-97e0-b539c4b70ace admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.659862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.660536 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.660818 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.661089 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.661828 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.663568 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.674372 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1392/2750] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:14.678361 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.680068 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.692097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f5f4a-51b2-43ef-bb1a-5af5b23002a9 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.696620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.697514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.697793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.698105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] PATH_INFO: `/v3/projects/0b73724c1b7742f18427fc5ac42458af/users/5ec402b2b5b940ad94ec0b793ad33aac/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.711601 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b73724c1b7742f18427fc5ac42458af, user_id=5ec402b2b5b940ad94ec0b793ad33aac, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.714887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.727070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1359/2751] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:14 2022] DELETE /identity/v3/users/b3066ffe4e3c4f7c89656e38feb5e76d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:14.784454 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1393/2752] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:14 2022] PUT /identity/v3/projects/0b73724c1b7742f18427fc5ac42458af/users/5ec402b2b5b940ad94ec0b793ad33aac/roles/246514336b4549609174329cae41663a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:14.789650 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.790081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.790359 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.807843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:14.809062 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.866189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1360/2753] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:14.875603 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:14.879200 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.937966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079df5d-4724-46ad-95c4-e3916c1e1c80 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.941629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd4ff0-9834-4d79-8abe-3025a7ba3838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.942469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4ff0-9834-4d79-8abe-3025a7ba3838 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.942856 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4ff0-9834-4d79-8abe-3025a7ba3838 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.943140 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd4ff0-9834-4d79-8abe-3025a7ba3838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.953645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd4ff0-9834-4d79-8abe-3025a7ba3838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.955101 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd4ff0-9834-4d79-8abe-3025a7ba3838 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.966530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1394/2754] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:15.164730 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.166151 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:15.178994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55426c44-1054-47f7-978b-ded995eb3f10 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.184527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.185396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.185678 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.186096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] PATH_INFO: `/v3/projects/6f19889005ae49468b2eee9ac80f907c` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.187312 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f19889005ae49468b2eee9ac80f907c)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.189288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.288744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f19889005ae49468b2eee9ac80f907c', 'request_id': 'req-1a4dde86-a1ed-4d50-82ce-e539ccc84407'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:15.295005 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f19889005ae49468b2eee9ac80f907c', 'request_id': 'req-1a4dde86-a1ed-4d50-82ce-e539ccc84407'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:15.302675 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f19889005ae49468b2eee9ac80f907c', 'request_id': 'req-1a4dde86-a1ed-4d50-82ce-e539ccc84407'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:15.397036 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] The token cache is being invalidate because project 6f19889005ae49468b2eee9ac80f907c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:15.397538 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:15.398552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-1a4dde86-a1ed-4d50-82ce-e539ccc84407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:15.401269 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1361/2755] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:15 2022] DELETE /identity/v3/projects/6f19889005ae49468b2eee9ac80f907c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:15.406216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.406716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.406832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.425857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:15.426970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:15.487145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1395/2756] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:15.495576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.495864 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.496141 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.514463 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:15.515685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:15.528741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1362/2757] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:15.533960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.546318 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb9ee-43a2-4ae0-bcc2-5e3e8975cef3 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.552936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.554456 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.554738 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.555015 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.555840 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:15.556144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.558458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.570660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1396/2758] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:15.575112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.584169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9e301-6738-4cb0-98e4-ad3a16921a88 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.589460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.589969 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.590272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.590548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.591262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.593216 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.701673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1363/2759] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:15 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:15.705897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.715808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecacb0-6cb1-471d-928c-cb64b8d42105 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.771379 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.772050 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.772337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.772649 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.773438 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.775297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.843046 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1397/2760] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:15 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:15.847213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.858298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec000af-a55d-42e3-9ba7-49ef308028e9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.863121 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.863782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.864065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.864340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.865139 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.866724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.877611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1364/2761] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:15.881702 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.891956 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1dd0f-4a33-455a-a3e0-934ca7da530a admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.896889 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed44613-08e0-4bdf-a354-71aec669c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.897673 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44613-08e0-4bdf-a354-71aec669c226 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.897955 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44613-08e0-4bdf-a354-71aec669c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.898252 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44613-08e0-4bdf-a354-71aec669c226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.898971 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed44613-08e0-4bdf-a354-71aec669c226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.900714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed44613-08e0-4bdf-a354-71aec669c226 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.911339 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1398/2762] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:15.915591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.925843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a799aac-70bc-4801-b8e3-104fc273002b admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.930762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37328c-26f3-4a9c-af21-8ac47f533e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.931637 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37328c-26f3-4a9c-af21-8ac47f533e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.931924 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37328c-26f3-4a9c-af21-8ac47f533e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.932227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37328c-26f3-4a9c-af21-8ac47f533e03 admin admin] PATH_INFO: `/v3/projects/eee074218f5d45c09d213dc996c172b5/users/9e6600897456464a8af678bd97146ebf/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.946762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37328c-26f3-4a9c-af21-8ac47f533e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee074218f5d45c09d213dc996c172b5, user_id=9e6600897456464a8af678bd97146ebf, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.949846 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37328c-26f3-4a9c-af21-8ac47f533e03 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.049427 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1365/2763] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:15 2022] PUT /identity/v3/projects/eee074218f5d45c09d213dc996c172b5/users/9e6600897456464a8af678bd97146ebf/roles/246514336b4549609174329cae41663a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:16.054520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.054810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.055113 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.072970 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:16.073725 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.131594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.131594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.131594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.135705 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1399/2764] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:16.145412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.146852 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.165809 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] MFA Rules not processed for user `5ec402b2b5b940ad94ec0b793ad33aac`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:16.167823 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.204443 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76a96-7481-4eb7-921d-eebef43b75b8 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.208690 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.209418 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.209645 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.209923 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.221181 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.222629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.233441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1366/2765] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:16.237708 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.238950 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.239069 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1400/2766] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:16.251917 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe22357-ce73-4a38-a03e-f0be7fb9df5c None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.256559 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.257207 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.257490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.257768 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.258457 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.260895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.355496 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1367/2767] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:16 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:16.359620 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.369619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54703d90-2ba0-45fe-865a-e185ec6632cc service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.425327 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.426008 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.426304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.426602 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.427304 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.429313 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.551664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1401/2768] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:16 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:16.555603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.565657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4447-f2dc-4557-b728-ada9c00b17a2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.570277 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.570930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.571215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.571493 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.572259 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.574508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.585318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1368/2769] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:16.590426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.600740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d2edc-158e-4f5d-8ed1-9b94a4fe7fb1 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.605508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.606527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.606819 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.607276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] PATH_INFO: `/v3/projects/20e0340d2289475eb1619f753d29eed6/users/08d06016794d4e49ad798349e7efe809/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.627353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e0340d2289475eb1619f753d29eed6, user_id=08d06016794d4e49ad798349e7efe809, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.630162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.689315 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1402/2770] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:16 2022] PUT /identity/v3/projects/20e0340d2289475eb1619f753d29eed6/users/08d06016794d4e49ad798349e7efe809/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:16.693295 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.704044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6dc2-0c4d-4334-8550-a6eaadf66710 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.757467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1245-426f-47b3-95fb-15dd9c83b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.758126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1245-426f-47b3-95fb-15dd9c83b348 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.758400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1245-426f-47b3-95fb-15dd9c83b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.758666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1245-426f-47b3-95fb-15dd9c83b348 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.759380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1245-426f-47b3-95fb-15dd9c83b348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.761855 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1245-426f-47b3-95fb-15dd9c83b348 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.771694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1369/2771] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:16.775813 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.786393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfca12-a165-420e-8038-da0446a7ff80 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.791202 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.792099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.792380 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.792686 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] PATH_INFO: `/v3/projects/20e0340d2289475eb1619f753d29eed6/users/08d06016794d4e49ad798349e7efe809/roles/2b566b9d44514140984818f0428be699` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.794640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e0340d2289475eb1619f753d29eed6, user_id=08d06016794d4e49ad798349e7efe809, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.797449 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.809823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1403/2772] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:16 2022] PUT /identity/v3/projects/20e0340d2289475eb1619f753d29eed6/users/08d06016794d4e49ad798349e7efe809/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:17.700593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203320-520a-427a-89b5-82f1febf05b1 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:17.701145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203320-520a-427a-89b5-82f1febf05b1 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:17.701145 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203320-520a-427a-89b5-82f1febf05b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:17.730033 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-b1203320-520a-427a-89b5-82f1febf05b1 None None] MFA Rules not processed for user `9e6600897456464a8af678bd97146ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:17.731288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b1203320-520a-427a-89b5-82f1febf05b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:17.798564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1370/2773] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:17.808450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:17.810128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:17.867711 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc971d-ee6b-4649-8428-9994771d2600 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:17.871325 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9978e92-e0c7-4363-b191-d2b7484065e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:17.871961 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978e92-e0c7-4363-b191-d2b7484065e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:17.872241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978e92-e0c7-4363-b191-d2b7484065e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:17.872547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978e92-e0c7-4363-b191-d2b7484065e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:17.881222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9978e92-e0c7-4363-b191-d2b7484065e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:17.887642 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9978e92-e0c7-4363-b191-d2b7484065e8 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:17.892495 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1404/2774] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:18.433452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:18.433750 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:18.434046 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:18.461380 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] MFA Rules not processed for user `08d06016794d4e49ad798349e7efe809`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:18.462619 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:18.532963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1371/2775] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:19.634331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57673333-75bb-49cb-8b33-baf726429506 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.634789 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57673333-75bb-49cb-8b33-baf726429506 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.634924 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57673333-75bb-49cb-8b33-baf726429506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.663230 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-57673333-75bb-49cb-8b33-baf726429506 None None] MFA Rules not processed for user `9e6600897456464a8af678bd97146ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:19.664484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-57673333-75bb-49cb-8b33-baf726429506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:19.674962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1405/2776] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:19.843596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.905998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b003-0d5c-4495-9315-63fef6e0e053 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.910867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.911662 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.911941 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.912214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] PATH_INFO: `/v3/users/5ec402b2b5b940ad94ec0b793ad33aac` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.913432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec402b2b5b940ad94ec0b793ad33aac)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.915347 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.066177 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec402b2b5b940ad94ec0b793ad33aac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.066835 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec402b2b5b940ad94ec0b793ad33aac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.073424 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec402b2b5b940ad94ec0b793ad33aac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.085606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec402b2b5b940ad94ec0b793ad33aac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.086252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec402b2b5b940ad94ec0b793ad33aac'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.155524 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1372/2777] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:19 2022] DELETE /identity/v3/users/5ec402b2b5b940ad94ec0b793ad33aac => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:20.410263 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57673333-75bb-49cb-8b33-baf726429506 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.429697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57673333-75bb-49cb-8b33-baf726429506 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.490225 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.491075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.491367 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.491640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] PATH_INFO: `/v3/projects/0b73724c1b7742f18427fc5ac42458af` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.492855 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b73724c1b7742f18427fc5ac42458af)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.494776 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.602145 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b73724c1b7742f18427fc5ac42458af', 'request_id': 'req-9496b3df-e95f-4bda-b9ea-13b3e9046ece'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.659409 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b73724c1b7742f18427fc5ac42458af', 'request_id': 'req-9496b3df-e95f-4bda-b9ea-13b3e9046ece'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.665867 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b73724c1b7742f18427fc5ac42458af', 'request_id': 'req-9496b3df-e95f-4bda-b9ea-13b3e9046ece'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.676791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] The token cache is being invalidate because project 0b73724c1b7742f18427fc5ac42458af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:20.677080 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.677754 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.679297 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1406/2778] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:20 2022] DELETE /identity/v3/projects/0b73724c1b7742f18427fc5ac42458af => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:20.683288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.684826 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:20.697402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2969b-cf6e-44b8-9098-e7aac2b1f7dd admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.753276 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.754260 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.754668 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.755026 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] PATH_INFO: `/v3/users/08d06016794d4e49ad798349e7efe809` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.756341 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d06016794d4e49ad798349e7efe809)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.758378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.941490 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d06016794d4e49ad798349e7efe809'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.942131 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d06016794d4e49ad798349e7efe809'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.948878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d06016794d4e49ad798349e7efe809'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.965534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d06016794d4e49ad798349e7efe809'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:20.966280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-503e5e5e-3b98-46cb-bc80-6a87625797cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d06016794d4e49ad798349e7efe809'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.041787 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1373/2779] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:20 2022] DELETE /identity/v3/users/08d06016794d4e49ad798349e7efe809 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:21.277823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.279303 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.292238 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496b3df-e95f-4bda-b9ea-13b3e9046ece admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.353480 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.354342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.354629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.354912 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] PATH_INFO: `/v3/projects/20e0340d2289475eb1619f753d29eed6` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.356223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e0340d2289475eb1619f753d29eed6)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.358207 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.472932 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e0340d2289475eb1619f753d29eed6', 'request_id': 'req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.551630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e0340d2289475eb1619f753d29eed6', 'request_id': 'req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.558452 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e0340d2289475eb1619f753d29eed6', 'request_id': 'req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.569997 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] The token cache is being invalidate because project 20e0340d2289475eb1619f753d29eed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:21.570308 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.570963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-d06b8333-0b1a-4b4e-b654-dab4f6ad200f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.572521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1407/2780] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:21 2022] DELETE /identity/v3/projects/20e0340d2289475eb1619f753d29eed6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:21.577459 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.578803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.578803 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.597104 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:21.598439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.657001 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1374/2781] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:21.665928 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.666450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.666553 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.685712 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:21.690473 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.694695 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1408/2782] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:21.699064 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.708584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504d08-86f0-43f9-8898-ece68d300daf None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.713290 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.713934 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.714218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.714498 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.715215 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:21.715523 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.717137 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.728884 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1375/2783] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:43:21.733780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.743081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacaadc-5506-433e-8c9c-2ba92c5a76b9 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.748377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.749052 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.749337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.749641 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.750348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.752265 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.825534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1409/2784] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:21 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:21.829589 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.839252 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b313b-3bbc-4eec-97b1-658fc4249f6e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.893568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.894238 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.894521 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.894794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.895495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.897452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.996606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1376/2785] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:21 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:22.000684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.010729 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debeead-2daa-48c4-b25b-c6daa4982bd7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.015596 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.016241 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.016564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.016841 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.017556 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.019153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.029694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1410/2786] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:22.033383 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.042929 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590993ca-480c-4584-af4e-e31b376f0061 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.048218 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03dc6a-de7c-41af-ab8f-de35d12237ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.048897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03dc6a-de7c-41af-ab8f-de35d12237ef admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.049181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03dc6a-de7c-41af-ab8f-de35d12237ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.049533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03dc6a-de7c-41af-ab8f-de35d12237ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.050204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03dc6a-de7c-41af-ab8f-de35d12237ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.051776 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03dc6a-de7c-41af-ab8f-de35d12237ef admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.061251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1377/2787] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:22.065316 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.074981 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367ac01-50ae-4c7f-808c-183c6554d793 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.079966 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.080832 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.081095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.081368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] PATH_INFO: `/v3/projects/a5274d4d92e3490f9b4a02241e4a79a2/users/f151496d801d4efb8bd6925fb114eed5/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.095700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5274d4d92e3490f9b4a02241e4a79a2, user_id=f151496d801d4efb8bd6925fb114eed5, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.098385 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.168003 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1411/2788] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:22 2022] PUT /identity/v3/projects/a5274d4d92e3490f9b4a02241e4a79a2/users/f151496d801d4efb8bd6925fb114eed5/roles/246514336b4549609174329cae41663a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:22.179066 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.179367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.179624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.207100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] MFA Rules not processed for user `f151496d801d4efb8bd6925fb114eed5`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:22.208301 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:22.270171 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1378/2789] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:22.274773 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.345025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87795-c9c7-4bfa-b480-208ecfc3b0f7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.350581 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.351237 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.351525 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.351808 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.352551 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.354721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.454126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1412/2790] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:22 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:22.455125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.465948 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d017eff-9e0f-457b-b1c1-ff29b0dc4d59 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.524222 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.524926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.525203 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.525475 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.526199 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.528092 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.642167 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1379/2791] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:22 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:22.646284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.656555 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad43abb-b452-4ed6-8346-1bb96b3ff0e7 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.661317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.661995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.662284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.662560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.663296 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.664938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.679087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1413/2792] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:22.681087 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.691099 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41ff4-e4a6-4507-b611-cf20a92f98d9 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.696986 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.697877 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.698181 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.698461 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] PATH_INFO: `/v3/projects/4103e4fe95224e3cb4d750efab67812c/users/2c07a953d0014d48973f759ae8300bbc/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.714700 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4103e4fe95224e3cb4d750efab67812c, user_id=2c07a953d0014d48973f759ae8300bbc, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.718091 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.798179 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1380/2793] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:22 2022] PUT /identity/v3/projects/4103e4fe95224e3cb4d750efab67812c/users/2c07a953d0014d48973f759ae8300bbc/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:22.802485 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.812450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0173881-8a8c-461f-b014-8ee949e25b18 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.868022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f22c-0a3d-46fe-ae76-6e193a86cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.868707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f22c-0a3d-46fe-ae76-6e193a86cda9 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.868995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f22c-0a3d-46fe-ae76-6e193a86cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.869419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f22c-0a3d-46fe-ae76-6e193a86cda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.870144 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560f22c-0a3d-46fe-ae76-6e193a86cda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.871866 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560f22c-0a3d-46fe-ae76-6e193a86cda9 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.881899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1414/2794] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:22.886230 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.897173 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e69d-2417-48ec-99a7-4bf28a6d97ab admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.901820 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.902688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.902987 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.903253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] PATH_INFO: `/v3/projects/4103e4fe95224e3cb4d750efab67812c/users/2c07a953d0014d48973f759ae8300bbc/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.905777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4103e4fe95224e3cb4d750efab67812c, user_id=2c07a953d0014d48973f759ae8300bbc, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.908419 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.918439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1381/2795] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:22 2022] PUT /identity/v3/projects/4103e4fe95224e3cb4d750efab67812c/users/2c07a953d0014d48973f759ae8300bbc/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:22.928926 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.929243 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.929520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.955694 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] MFA Rules not processed for user `2c07a953d0014d48973f759ae8300bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:22.956944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:23.028434 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1415/2796] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:23.038804 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:23.040533 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:23.097893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dc116-f219-48ff-9da0-f7391aeaee01 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:23.101967 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:23.102611 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.102895 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.103176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.112402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:23.113862 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:23.123591 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1382/2797] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:23.213999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:23.224415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fc815-6d4d-4c9c-b982-981daf067de9 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:23.228112 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758726fb-ac3e-4e77-8a8f-67fb5b725475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:23.228793 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758726fb-ac3e-4e77-8a8f-67fb5b725475 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.229228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758726fb-ac3e-4e77-8a8f-67fb5b725475 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.229530 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758726fb-ac3e-4e77-8a8f-67fb5b725475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.286109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758726fb-ac3e-4e77-8a8f-67fb5b725475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:23.287640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758726fb-ac3e-4e77-8a8f-67fb5b725475 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:23.296929 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1416/2798] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:26.297822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:26.366410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670963f-6fe3-42b7-9276-0ec08d80cb4a service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:26.371272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:26.372158 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:26.372452 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:26.372739 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] PATH_INFO: `/v3/users/f151496d801d4efb8bd6925fb114eed5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:26.373980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f151496d801d4efb8bd6925fb114eed5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:26.375872 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:26.558685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f151496d801d4efb8bd6925fb114eed5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:26.559298 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f151496d801d4efb8bd6925fb114eed5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:26.565952 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f151496d801d4efb8bd6925fb114eed5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:26.577135 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f151496d801d4efb8bd6925fb114eed5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:26.577755 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f151496d801d4efb8bd6925fb114eed5'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:26.653534 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1383/2799] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:26 2022] DELETE /identity/v3/users/f151496d801d4efb8bd6925fb114eed5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:26.658666 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:26.659146 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:26.659245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:26.676059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:26.677298 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:26.737285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1417/2800] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:26.747150 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:26.748569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:26.803719 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3d113-1353-47bc-b911-6eb9c04ae8b8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:26.807372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:26.808002 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:26.808288 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:26.808593 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:26.817355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:26.818741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:26.828227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1384/2801] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:27.232691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:27.237696 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:27.245910 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2e709-b5e3-49fe-bd1d-bdd1d3220f4f None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:27.251098 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:27.251963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:27.252229 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:27.252544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] PATH_INFO: `/v3/projects/a5274d4d92e3490f9b4a02241e4a79a2` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:27.253740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5274d4d92e3490f9b4a02241e4a79a2)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:27.255697 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:27.360941 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5274d4d92e3490f9b4a02241e4a79a2', 'request_id': 'req-763c133a-63cc-4a8a-9658-7b0da82f0c2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.418354 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5274d4d92e3490f9b4a02241e4a79a2', 'request_id': 'req-763c133a-63cc-4a8a-9658-7b0da82f0c2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.425685 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5274d4d92e3490f9b4a02241e4a79a2', 'request_id': 'req-763c133a-63cc-4a8a-9658-7b0da82f0c2e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.435749 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] The token cache is being invalidate because project a5274d4d92e3490f9b4a02241e4a79a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:27.440036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.440036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.440036 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1418/2802] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:27 2022] DELETE /identity/v3/projects/a5274d4d92e3490f9b4a02241e4a79a2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:27.442740 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:27.452153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fc7e-d2ce-49f7-8e58-b24902d54786 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:27.505903 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:27.506766 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:27.507050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:27.507328 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] PATH_INFO: `/v3/users/2c07a953d0014d48973f759ae8300bbc` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:27.508527 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c07a953d0014d48973f759ae8300bbc)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:27.510441 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:27.741995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c07a953d0014d48973f759ae8300bbc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.742643 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c07a953d0014d48973f759ae8300bbc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.750225 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c07a953d0014d48973f759ae8300bbc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.761316 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c07a953d0014d48973f759ae8300bbc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.766963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-69c492bc-6c16-4394-bc2e-f7d5b4a0d2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c07a953d0014d48973f759ae8300bbc'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:27.830596 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1385/2803] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:27 2022] DELETE /identity/v3/users/2c07a953d0014d48973f759ae8300bbc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:28.216010 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.218122 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:28.230549 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c133a-63cc-4a8a-9658-7b0da82f0c2e admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.287490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.288348 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.288668 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.288938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] PATH_INFO: `/v3/projects/4103e4fe95224e3cb4d750efab67812c` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.290115 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4103e4fe95224e3cb4d750efab67812c)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.292025 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.397114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4103e4fe95224e3cb4d750efab67812c', 'request_id': 'req-88a92f4d-ea90-4e2c-af53-b47cc697ea75'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.465153 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4103e4fe95224e3cb4d750efab67812c', 'request_id': 'req-88a92f4d-ea90-4e2c-af53-b47cc697ea75'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.472471 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4103e4fe95224e3cb4d750efab67812c', 'request_id': 'req-88a92f4d-ea90-4e2c-af53-b47cc697ea75'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.482700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] The token cache is being invalidate because project 4103e4fe95224e3cb4d750efab67812c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:28.482996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.483734 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-88a92f4d-ea90-4e2c-af53-b47cc697ea75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.485527 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1419/2804] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:28 2022] DELETE /identity/v3/projects/4103e4fe95224e3cb4d750efab67812c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:28.491261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.491757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.491880 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.510953 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:28.512659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:28.571661 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1386/2805] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:28.581547 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.581814 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.582093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.599624 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:28.600862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:28.608795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1420/2806] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:28.612830 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.622476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edec27-b5db-4148-921c-d13fe1b14de7 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.627649 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.628304 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.628624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.628902 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.629716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:28.630025 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.631610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.643743 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1387/2807] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:28.648320 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.657605 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920b14a-b9db-45e8-8a88-f6b252a69a47 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.662417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.663070 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.663417 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.663698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.664400 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.666317 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.786501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1421/2808] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:28 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:28.790620 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.800149 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170824-9eb3-4764-af1d-fb28b5eec4e0 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.853100 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.853758 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.854040 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.854315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.855106 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.857037 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.916069 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1388/2809] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:28 2022] POST /identity/v3/users => generated 305 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:28.920586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.930815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2510e-e862-4c4d-8ba9-0f9289728044 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.935487 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.936779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.937058 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.937331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.938156 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.939753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.949797 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1422/2810] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:28.953552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.963003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709b195-e1e6-4502-a314-74502094306e admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.967645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc6f0c-80f9-4665-b4ed-4bca4e31d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.968248 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc6f0c-80f9-4665-b4ed-4bca4e31d946 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.968566 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc6f0c-80f9-4665-b4ed-4bca4e31d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.968844 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc6f0c-80f9-4665-b4ed-4bca4e31d946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.969562 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc6f0c-80f9-4665-b4ed-4bca4e31d946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.971124 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc6f0c-80f9-4665-b4ed-4bca4e31d946 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.980886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1389/2811] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:28.985374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.995029 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073679a-ef67-470f-a34d-510419f5c001 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.000185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.001078 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.001360 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.001660 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] PATH_INFO: `/v3/projects/5c4416dd3b004548a208dc878650fa7c/users/6643d7c6c20843548bd71c83821ef71d/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.015630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4416dd3b004548a208dc878650fa7c, user_id=6643d7c6c20843548bd71c83821ef71d, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.018312 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.082335 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1423/2812] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:28 2022] PUT /identity/v3/projects/5c4416dd3b004548a208dc878650fa7c/users/6643d7c6c20843548bd71c83821ef71d/roles/246514336b4549609174329cae41663a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:29.092671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.092963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.093249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.118930 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] MFA Rules not processed for user `6643d7c6c20843548bd71c83821ef71d`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:29.120119 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:29.180852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1390/2813] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:29.185216 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.244185 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0b0e7-0633-4c08-9eaf-64bd6188d0b2 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.249520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.250163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.250444 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.250719 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.251405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.253384 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.346520 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1424/2814] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:29 2022] POST /identity/v3/projects => generated 409 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:29.350552 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.361510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8c3e-edb5-4007-82f3-8ba35ef24287 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.413394 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.414044 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.414323 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.414594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.415273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.417190 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.482082 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1391/2815] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:29 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:29.486646 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.497260 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509fa4f-bc9a-4f4d-b984-b0cf949756b5 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.501976 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.502630 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.502915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.503192 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.503938 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.505582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.516065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1425/2816] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:29.520003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.530617 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757e51-e4e6-4511-91db-98aa0eba9bb7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.534859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.535724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.535998 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.536265 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] PATH_INFO: `/v3/projects/8b045940deb74ee886167e03817ee579/users/80105231879e4775b174d2bd584f0f39/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.551023 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b045940deb74ee886167e03817ee579, user_id=80105231879e4775b174d2bd584f0f39, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.553707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.615744 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1392/2817] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:29 2022] PUT /identity/v3/projects/8b045940deb74ee886167e03817ee579/users/80105231879e4775b174d2bd584f0f39/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:29.619579 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.629582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083873-9f58-46ce-920c-efdc2369290b admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.685963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85e1f-3b86-4680-b9d0-f206a6366e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.686634 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85e1f-3b86-4680-b9d0-f206a6366e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.686916 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85e1f-3b86-4680-b9d0-f206a6366e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.687193 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85e1f-3b86-4680-b9d0-f206a6366e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.688236 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85e1f-3b86-4680-b9d0-f206a6366e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.689532 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85e1f-3b86-4680-b9d0-f206a6366e1f admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.699175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1426/2818] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:29.704022 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.714075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be778-cd1e-4a93-b059-f9d02b5deb04 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.719300 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.720160 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.720465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.720762 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] PATH_INFO: `/v3/projects/8b045940deb74ee886167e03817ee579/users/80105231879e4775b174d2bd584f0f39/roles/2b566b9d44514140984818f0428be699` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.722707 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b045940deb74ee886167e03817ee579, user_id=80105231879e4775b174d2bd584f0f39, role_id=2b566b9d44514140984818f0428be699)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.725382 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.735204 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1393/2819] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:29 2022] PUT /identity/v3/projects/8b045940deb74ee886167e03817ee579/users/80105231879e4775b174d2bd584f0f39/roles/2b566b9d44514140984818f0428be699 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:29.746197 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.746497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.746778 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.773737 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] MFA Rules not processed for user `80105231879e4775b174d2bd584f0f39`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:29.777100 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:29.839845 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1427/2820] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:29 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:29.849788 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.851465 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:29.906736 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f434f-3638-43f8-9d41-110eaad5ce30 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.910977 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.911695 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.911893 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.912196 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.921503 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.922946 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.932402 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1394/2821] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:30.334109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:30.344148 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834d49-16aa-4230-b9f6-435c4b2fde92 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:30.347647 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc28f2-9742-4f8d-9adc-d597820b28b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:30.348276 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc28f2-9742-4f8d-9adc-d597820b28b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:30.348586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc28f2-9742-4f8d-9adc-d597820b28b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:30.348862 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc28f2-9742-4f8d-9adc-d597820b28b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:30.407283 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc28f2-9742-4f8d-9adc-d597820b28b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:30.408753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc28f2-9742-4f8d-9adc-d597820b28b4 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:30.417787 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1428/2822] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:41.203757 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:41.262908 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486dae-53c8-4c06-a933-78d1c7fb753d service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:41.268118 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:41.269003 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:41.269293 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:41.269564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] PATH_INFO: `/v3/users/6643d7c6c20843548bd71c83821ef71d` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:41.270738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6643d7c6c20843548bd71c83821ef71d)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:41.272673 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:41.458125 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6643d7c6c20843548bd71c83821ef71d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:41.458686 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6643d7c6c20843548bd71c83821ef71d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:41.465603 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6643d7c6c20843548bd71c83821ef71d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:41.477067 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6643d7c6c20843548bd71c83821ef71d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:41.480568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6643d7c6c20843548bd71c83821ef71d'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:41.562733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1395/2823] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:41 2022] DELETE /identity/v3/users/6643d7c6c20843548bd71c83821ef71d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:41.567406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100324f-2e26-412f-914c-f350db24934b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:41.567887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100324f-2e26-412f-914c-f350db24934b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:41.567999 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100324f-2e26-412f-914c-f350db24934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:41.585288 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-7100324f-2e26-412f-914c-f350db24934b None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:41.586463 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7100324f-2e26-412f-914c-f350db24934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:41.647968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1429/2824] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:41.657604 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:41.658997 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:41.715123 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ddb8-55ab-4616-8411-37383c9e0bf2 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:41.725454 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:41.726129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:41.726415 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:41.726694 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:41.737081 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:41.738512 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:41.750433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1396/2825] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:42.404247 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100324f-2e26-412f-914c-f350db24934b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:42.406371 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7100324f-2e26-412f-914c-f350db24934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:42.421085 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100324f-2e26-412f-914c-f350db24934b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:42.425887 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:42.427762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:42.427762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:42.427762 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] PATH_INFO: `/v3/projects/5c4416dd3b004548a208dc878650fa7c` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:42.429472 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4416dd3b004548a208dc878650fa7c)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:42.431394 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:42.554002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4416dd3b004548a208dc878650fa7c', 'request_id': 'req-1ff26854-e21a-4a9a-99c0-7697b135beb3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.629595 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4416dd3b004548a208dc878650fa7c', 'request_id': 'req-1ff26854-e21a-4a9a-99c0-7697b135beb3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.636290 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4416dd3b004548a208dc878650fa7c', 'request_id': 'req-1ff26854-e21a-4a9a-99c0-7697b135beb3'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.647105 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] The token cache is being invalidate because project 5c4416dd3b004548a208dc878650fa7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:42.647388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.648014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.649580 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1430/2826] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:42 2022] DELETE /identity/v3/projects/5c4416dd3b004548a208dc878650fa7c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:42.653569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:42.663446 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa427-9d40-46ea-8cdc-261ec7ce1210 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:42.718165 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:42.719027 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:42.719311 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:42.719584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] PATH_INFO: `/v3/users/80105231879e4775b174d2bd584f0f39` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:42.720798 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80105231879e4775b174d2bd584f0f39)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:42.722709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:42.968843 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80105231879e4775b174d2bd584f0f39'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.969508 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80105231879e4775b174d2bd584f0f39'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.976324 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80105231879e4775b174d2bd584f0f39'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.988296 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80105231879e4775b174d2bd584f0f39'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:42.988979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-9f53ccfa-cbed-45c5-9c71-dbf03f92a67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80105231879e4775b174d2bd584f0f39'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:43.052726 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1397/2827] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:42 2022] DELETE /identity/v3/users/80105231879e4775b174d2bd584f0f39 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:43.478342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:43.479849 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:43.493374 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff26854-e21a-4a9a-99c0-7697b135beb3 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:43.548980 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:43.549836 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:43.550121 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:43.550405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] PATH_INFO: `/v3/projects/8b045940deb74ee886167e03817ee579` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:43.551585 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b045940deb74ee886167e03817ee579)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:43.553535 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:43.703336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b045940deb74ee886167e03817ee579', 'request_id': 'req-56a5603d-dbb4-4195-b180-0081d5a13894'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:43.772172 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b045940deb74ee886167e03817ee579', 'request_id': 'req-56a5603d-dbb4-4195-b180-0081d5a13894'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:43.778455 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b045940deb74ee886167e03817ee579', 'request_id': 'req-56a5603d-dbb4-4195-b180-0081d5a13894'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:43.789572 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] The token cache is being invalidate because project 8b045940deb74ee886167e03817ee579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:43.789859 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:43.790497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-56a5603d-dbb4-4195-b180-0081d5a13894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:43.792018 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1431/2828] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:43 2022] DELETE /identity/v3/projects/8b045940deb74ee886167e03817ee579 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:43.797530 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:43.798007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:43.798112 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:43.815041 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:43.816249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:43.872126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1398/2829] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:43.879703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:43.879990 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:43.880259 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:43.898714 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:43.899880 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:43.908137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1432/2830] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:43.912208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:43.921635 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f12005-ac13-45b6-b729-e06c9217d893 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:43.926400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:43.927083 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:43.927369 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:43.927645 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:43.928381 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:43.928724 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:43.930351 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:43.942829 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1399/2831] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:43:43.947501 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:43.957599 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16917-de2b-43ec-a33b-f9541a122953 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:43.962210 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:43.962857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:43.963137 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:43.963412 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:43.964093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:43.966065 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.048615 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1433/2832] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:43 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:44.052836 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:44.062598 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8407bdf-a93f-45d1-b3f3-359f12a99aad admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:44.116432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:44.117113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.117396 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.117670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.118357 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:44.120283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.198086 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1400/2833] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:44 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:44.202462 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:44.212806 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a52b-7bd0-463e-999b-195f8ade0dd6 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:44.218042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:44.218684 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.218963 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.219273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.219995 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:44.221618 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.231665 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1434/2834] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:44.235500 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:44.245126 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1307af-e47c-48f9-9199-8a544dd6837c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:44.250154 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5ca3c-04f0-45b7-8a1d-7d3c8a617736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:44.250794 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ca3c-04f0-45b7-8a1d-7d3c8a617736 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.251071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ca3c-04f0-45b7-8a1d-7d3c8a617736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.251340 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ca3c-04f0-45b7-8a1d-7d3c8a617736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.252048 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5ca3c-04f0-45b7-8a1d-7d3c8a617736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:44.253646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5ca3c-04f0-45b7-8a1d-7d3c8a617736 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.263376 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1401/2835] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:44.267992 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:44.277698 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922950-6208-4c60-a108-ba9714b3ea39 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:44.282301 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:44.283155 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.283433 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.283703 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] PATH_INFO: `/v3/projects/94c4cfdc9f184d1c89f73461deca3ed5/users/52708fa163274ee1a9907b326c65b4eb/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.297563 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c4cfdc9f184d1c89f73461deca3ed5, user_id=52708fa163274ee1a9907b326c65b4eb, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:44.300245 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.378365 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1435/2836] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:44 2022] PUT /identity/v3/projects/94c4cfdc9f184d1c89f73461deca3ed5/users/52708fa163274ee1a9907b326c65b4eb/roles/246514336b4549609174329cae41663a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:44.388834 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.391944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.391944 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.428657 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] MFA Rules not processed for user `52708fa163274ee1a9907b326c65b4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:44.429897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:44.492373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1402/2837] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:44.502826 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:44.504657 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:44.559204 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033e896-c581-40df-bddb-dc4ee14a5e42 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:44.563284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e79ed-bf32-4969-b2cd-752a3f474288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:44.563918 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e79ed-bf32-4969-b2cd-752a3f474288 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.564203 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e79ed-bf32-4969-b2cd-752a3f474288 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.564515 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e79ed-bf32-4969-b2cd-752a3f474288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.572745 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e79ed-bf32-4969-b2cd-752a3f474288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:44.574174 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e79ed-bf32-4969-b2cd-752a3f474288 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.583377 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1436/2838] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:44.601897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:44.663925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce5d4c-e4a3-43b5-89eb-8eb7f62eef95 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:44.668561 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:44.669433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.669718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.669995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] PATH_INFO: `/v3/users/52708fa163274ee1a9907b326c65b4eb` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.671722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52708fa163274ee1a9907b326c65b4eb)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:44.673688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:44.831780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52708fa163274ee1a9907b326c65b4eb'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:44.832612 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52708fa163274ee1a9907b326c65b4eb'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:44.839101 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52708fa163274ee1a9907b326c65b4eb'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:44.851128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52708fa163274ee1a9907b326c65b4eb'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:44.851942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52708fa163274ee1a9907b326c65b4eb'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:44.934189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1403/2839] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:44 2022] DELETE /identity/v3/users/52708fa163274ee1a9907b326c65b4eb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:44.939507 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:44.945396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:44.945396 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:44.956865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:44.958053 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.018114 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1437/2840] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:45.027806 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:45.029253 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.087097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371f66-8cde-4d3e-9890-bb1bf44040c1 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:45.093410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad558f-9960-4c57-b301-c8625465785b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:45.094511 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad558f-9960-4c57-b301-c8625465785b service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.095017 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad558f-9960-4c57-b301-c8625465785b service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.095510 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad558f-9960-4c57-b301-c8625465785b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.105343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad558f-9960-4c57-b301-c8625465785b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:45.106789 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad558f-9960-4c57-b301-c8625465785b service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:45.116852 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1404/2841] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:45.501176 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:45.505007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.514724 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ac135-dc9d-4a57-b5f4-2366cb1b6eba None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:45.519342 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:45.520194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.520504 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.520785 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] PATH_INFO: `/v3/projects/94c4cfdc9f184d1c89f73461deca3ed5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.521979 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c4cfdc9f184d1c89f73461deca3ed5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:45.523921 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:45.613272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c4cfdc9f184d1c89f73461deca3ed5', 'request_id': 'req-77d33b90-9243-4d4d-8078-cc35a6e7865e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:45.658958 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c4cfdc9f184d1c89f73461deca3ed5', 'request_id': 'req-77d33b90-9243-4d4d-8078-cc35a6e7865e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:45.665359 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c4cfdc9f184d1c89f73461deca3ed5', 'request_id': 'req-77d33b90-9243-4d4d-8078-cc35a6e7865e'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:45.675933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] The token cache is being invalidate because project 94c4cfdc9f184d1c89f73461deca3ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:45.676214 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:45.676942 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-77d33b90-9243-4d4d-8078-cc35a6e7865e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:45.678388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1438/2842] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:45 2022] DELETE /identity/v3/projects/94c4cfdc9f184d1c89f73461deca3ed5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:45.683439 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.683733 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.684012 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.702166 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:45.703349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.759577 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1405/2843] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:45.768540 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.768820 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.769097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.787544 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:45.788810 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:45.801346 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1439/2844] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:45.803772 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:45.813956 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d9661-f0ff-42c4-90f6-eafcd3fd3eb0 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:45.818604 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:45.819264 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.819547 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.819824 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.820582 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:45.820886 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:45.822495 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:45.834080 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1406/2845] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:45.838475 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:45.848031 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce855d-36a9-47c1-96a9-05d88413246e None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:45.852586 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:45.853219 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:45.853497 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:45.853770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:45.854459 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:45.856337 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:45.951560 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1440/2846] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:45 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:45.955670 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:45.965482 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d5a0e-5fbb-444b-b81f-547e242b6aa3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:46.019156 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:46.019808 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.020093 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.020366 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] PATH_INFO: `/v3/users` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.021084 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:46.022980 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:46.111771 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1407/2847] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:45 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:46.115629 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:46.125511 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111348f9-cd5c-4045-be35-c2483ac56c69 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:46.130082 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:46.131441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.131441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.131441 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.131944 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:46.133554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:46.145779 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1441/2848] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:46.151904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:46.162629 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6d7f-9be5-47bf-bc6a-947e0a9af59c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:46.167728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162a50-ace5-4845-aa1f-3a23e140ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:46.168370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162a50-ace5-4845-aa1f-3a23e140ada1 admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.168671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162a50-ace5-4845-aa1f-3a23e140ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.168943 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162a50-ace5-4845-aa1f-3a23e140ada1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.169659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162a50-ace5-4845-aa1f-3a23e140ada1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:46.171315 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162a50-ace5-4845-aa1f-3a23e140ada1 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:46.181189 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1408/2849] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:46.185300 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:46.195090 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672eb3-4a7f-41ca-b68d-5b9d488208d4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:46.199638 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:46.200523 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.200809 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.201083 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] PATH_INFO: `/v3/projects/8af4bed604ef4015929214d402588d34/users/ae83f98e32d34dac973b88b778febaec/roles/246514336b4549609174329cae41663a` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.216326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af4bed604ef4015929214d402588d34, user_id=ae83f98e32d34dac973b88b778febaec, role_id=246514336b4549609174329cae41663a)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:46.219534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:46.304888 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1442/2850] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:46 2022] PUT /identity/v3/projects/8af4bed604ef4015929214d402588d34/users/ae83f98e32d34dac973b88b778febaec/roles/246514336b4549609174329cae41663a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:46.310071 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920b19-1643-4e66-a267-582a37aeda6c None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.310360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920b19-1643-4e66-a267-582a37aeda6c None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.310659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920b19-1643-4e66-a267-582a37aeda6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.328791 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-cd920b19-1643-4e66-a267-582a37aeda6c None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:46.331979 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-cd920b19-1643-4e66-a267-582a37aeda6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:46.385451 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1409/2851] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:46.395968 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:46.397655 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:46.460883 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbee3f8-4466-40e0-93f1-945d583e2e5d admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:46.464437 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:46.465171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.465494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.465770 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.475582 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:46.476977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:46.486173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1443/2852] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:47.686932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217033-011b-42d7-9b44-7f19318b0577 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:47.687444 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217033-011b-42d7-9b44-7f19318b0577 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:47.687624 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217033-011b-42d7-9b44-7f19318b0577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:47.718332 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-bd217033-011b-42d7-9b44-7f19318b0577 None None] MFA Rules not processed for user `ae83f98e32d34dac973b88b778febaec`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:47.719564 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-bd217033-011b-42d7-9b44-7f19318b0577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:47.782767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1410/2853] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:47.793541 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:47.794989 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:47.849334 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e93ae-88eb-43b4-9199-7737bcfa47e8 service neutron] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:47.852915 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140a8d4-2f92-4965-90d3-3a6290cd8060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:47.853548 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140a8d4-2f92-4965-90d3-3a6290cd8060 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:47.853830 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140a8d4-2f92-4965-90d3-3a6290cd8060 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:47.854109 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140a8d4-2f92-4965-90d3-3a6290cd8060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:47.862246 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140a8d4-2f92-4965-90d3-3a6290cd8060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:47.863678 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140a8d4-2f92-4965-90d3-3a6290cd8060 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:47.872351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1444/2854] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:50.702777 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:50.703266 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:50.703372 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:50.720627 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] MFA Rules not processed for user `ae83f98e32d34dac973b88b778febaec`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:50.721810 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:50.728659 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1411/2855] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:43:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:13.813672 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188457-5c6c-4fce-b3ba-9b1c5bdff5c6 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:13.814163 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188457-5c6c-4fce-b3ba-9b1c5bdff5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:13.814268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188457-5c6c-4fce-b3ba-9b1c5bdff5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:13.831273 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-8c188457-5c6c-4fce-b3ba-9b1c5bdff5c6 None None] MFA Rules not processed for user `ae83f98e32d34dac973b88b778febaec`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:13.832458 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-8c188457-5c6c-4fce-b3ba-9b1c5bdff5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:13.839179 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1445/2856] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:29.091221 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:29.093349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:29.222937 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d63f9-1759-4fc3-b2d8-9b0ff16e7b16 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:29.228728 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:29.229370 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:29.229623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:29.230213 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:29.231991 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:29.244333 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:29.246049 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:29.257191 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1412/2857] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:49.036388 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9987-12c1-46e0-aedc-f923d6c08763 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:49.036933 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9987-12c1-46e0-aedc-f923d6c08763 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:49.037059 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9987-12c1-46e0-aedc-f923d6c08763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:49.054788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-fcba9987-12c1-46e0-aedc-f923d6c08763 None None] MFA Rules not processed for user `9e6600897456464a8af678bd97146ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:49.055987 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-fcba9987-12c1-46e0-aedc-f923d6c08763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:49.108173 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1446/2858] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:49.333408 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:49.353219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416846-72dd-47a5-a065-711cf95ccced service nova] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:49.357176 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:49.357867 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:49.358152 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:49.358432 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:49.360317 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:49.381053 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:49.382460 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:49.391247 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1413/2859] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:49.406387 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363a59-462a-4b82-ac62-5c3075dfa04e None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:49.406676 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363a59-462a-4b82-ac62-5c3075dfa04e None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:49.406950 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de363a59-462a-4b82-ac62-5c3075dfa04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:49.429234 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-de363a59-462a-4b82-ac62-5c3075dfa04e None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:49.430447 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-de363a59-462a-4b82-ac62-5c3075dfa04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:49.486055 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1447/2860] 10.222.0.90 () {58 vars in 1009 bytes} [Mon Feb 21 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:49.611623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:49.613373 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:49.680280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3760bf-84a6-4dc0-8707-1e52a6070815 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:49.685413 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:49.686557 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:49.686838 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:49.687113 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:49.694911 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:49.696504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:49.704926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1414/2861] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:44:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:06.555095 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:06.555612 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:06.555721 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:06.573457 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] MFA Rules not processed for user `e5e097a1fd9345fca696a23719a81c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:06.574632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:06.581562 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1448/2862] 10.222.0.90 () {58 vars in 967 bytes} [Mon Feb 21 01:45:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:06.593407 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:06.603665 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698bfa-88ba-4e21-af5d-62113ce45e0e service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:06.609584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126d69c4bcf42aaa7d5b85e40e93582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:06.610214 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:06.610494 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:06.610767 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:06.623307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:06.623307 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:06.629313 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1415/2863] 10.222.0.90 () {60 vars in 1384 bytes} [Mon Feb 21 01:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:09.464640 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:09.494633 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a302-9f07-4e29-8379-ede3dc11998b None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:09.499811 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:09.500691 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:09.500972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:09.501242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] PATH_INFO: `/v3/users/ae83f98e32d34dac973b88b778febaec` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:09.502415 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae83f98e32d34dac973b88b778febaec)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:09.504326 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:09.654376 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae83f98e32d34dac973b88b778febaec'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:09.661034 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae83f98e32d34dac973b88b778febaec'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:09.673074 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae83f98e32d34dac973b88b778febaec'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:09.721362 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae83f98e32d34dac973b88b778febaec'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:09.721953 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-988aba00-fdf7-4ff3-a950-d2873a1b8eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae83f98e32d34dac973b88b778febaec'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:09.728042 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1449/2864] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:45:09 2022] DELETE /identity/v3/users/ae83f98e32d34dac973b88b778febaec => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:09.968869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:09.980251 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d20de-78d9-477a-b00c-e7e9dbd7ace2 service swift] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.036057 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.036940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.037219 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.037492 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] PATH_INFO: `/v3/projects/8af4bed604ef4015929214d402588d34` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.038660 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af4bed604ef4015929214d402588d34)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.040594 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.158146 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af4bed604ef4015929214d402588d34', 'request_id': 'req-20054333-5df6-4a88-a776-0c50e3ecdddf'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:10.164122 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af4bed604ef4015929214d402588d34', 'request_id': 'req-20054333-5df6-4a88-a776-0c50e3ecdddf'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:10.169951 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af4bed604ef4015929214d402588d34', 'request_id': 'req-20054333-5df6-4a88-a776-0c50e3ecdddf'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:10.255722 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] The token cache is being invalidate because project 8af4bed604ef4015929214d402588d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:45:10.255958 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:10.256532 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-20054333-5df6-4a88-a776-0c50e3ecdddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:10.258061 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1416/2865] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:45:09 2022] DELETE /identity/v3/projects/8af4bed604ef4015929214d402588d34 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:10.263708 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.263996 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.264274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.317962 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:10.319093 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:10.376662 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1450/2866] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:10.384143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.384540 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.384899 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.402753 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:10.404579 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:10.412235 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1417/2867] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:10.416154 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:10.425498 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f326f-b9c4-4e6e-86c6-ee7456f98088 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.430397 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.431051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.431333 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.431609 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] PATH_INFO: `/v3/domains` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.432331 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:45:10.432687 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.434285 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.446521 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1451/2868] 10.222.0.90 () {58 vars in 1152 bytes} [Mon Feb 21 01:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:45:10.452420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:10.461576 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ba12-65fc-4283-ba31-119e27b37c81 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.467015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.467709 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.467994 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.468273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.469007 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.470926 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.597847 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1418/2869] 10.222.0.90 () {60 vars in 1152 bytes} [Mon Feb 21 01:45:10 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:45:10.602045 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:10.613286 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f17a0f-a0c5-4d8f-94d1-51aee066a761 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.667545 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.668228 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.668936 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.669222 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.670552 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.672484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.743693 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1452/2870] 10.222.0.90 () {60 vars in 1143 bytes} [Mon Feb 21 01:45:10 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:45:10.747850 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:10.758169 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614e96-5177-4a7a-8e4e-ca5bfcb0cff3 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.763153 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.763797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.764077 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.764349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] PATH_INFO: `/v3/roles` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.765096 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.766671 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.776355 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1419/2871] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:45:10.780576 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:10.790491 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f593fb-2564-4227-b3ba-7259730fbbb4 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.795795 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5bd8-8b16-409d-ae98-8d3d15bd90c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.796494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5bd8-8b16-409d-ae98-8d3d15bd90c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.796777 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5bd8-8b16-409d-ae98-8d3d15bd90c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.797051 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5bd8-8b16-409d-ae98-8d3d15bd90c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.797791 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5bd8-8b16-409d-ae98-8d3d15bd90c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.799368 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5bd8-8b16-409d-ae98-8d3d15bd90c1 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.808919 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1453/2872] 10.222.0.90 () {58 vars in 1121 bytes} [Mon Feb 21 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:45:10.812734 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:10.822065 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14fdba-3e7d-437a-9e14-2f12beabe74c admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:10.827283 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:10.828239 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.828548 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.828876 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] PATH_INFO: `/v3/projects/13e35f3990a84544aa5cd9389b1469c0/users/14f8af1196d34779ad387f1d624bd227/roles/246514336b4549609174329cae41663a` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:10.854255 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e35f3990a84544aa5cd9389b1469c0, user_id=14f8af1196d34779ad387f1d624bd227, role_id=246514336b4549609174329cae41663a)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:10.856999 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:10.924504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1420/2873] 10.222.0.90 () {60 vars in 1482 bytes} [Mon Feb 21 01:45:10 2022] PUT /identity/v3/projects/13e35f3990a84544aa5cd9389b1469c0/users/14f8af1196d34779ad387f1d624bd227/roles/246514336b4549609174329cae41663a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:45:10.988998 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:10.989282 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:10.989558 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:11.015648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] MFA Rules not processed for user `14f8af1196d34779ad387f1d624bd227`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:11.016857 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:11.079094 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1454/2874] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:11.088551 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:11.090229 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:11.146140 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876037-d5ec-4e50-b165-00341e9860b8 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:11.149822 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:11.150455 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:11.150738 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:11.151015 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:11.159648 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:11.161094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:11.169651 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1421/2875] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:22.764351 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:22.767960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:22.858587 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ca7be-5fa3-48bb-9b82-b4b3f6effa54 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:22.864119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:22.864846 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:22.865126 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:22.865405 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:22.867262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:22.878484 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:22.880097 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452b794-8c77-4eb0-b488-bf21101a2f6a service placement] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:22.890652 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1455/2876] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:28.362504 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:28.421647 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fabef9-2452-454c-af96-bf3b07697081 service cinder] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:28.426094 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:28.426935 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:28.427210 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:28.427476 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] PATH_INFO: `/v3/users/14f8af1196d34779ad387f1d624bd227` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:28.428667 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f8af1196d34779ad387f1d624bd227)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:28.430569 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:28.648568 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f8af1196d34779ad387f1d624bd227'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:28.649256 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f8af1196d34779ad387f1d624bd227'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:28.661819 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f8af1196d34779ad387f1d624bd227'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:28.669105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f8af1196d34779ad387f1d624bd227'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:28.669779 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f8af1196d34779ad387f1d624bd227'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:28.749272 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1422/2877] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:45:28 2022] DELETE /identity/v3/users/14f8af1196d34779ad387f1d624bd227 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:28.753925 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] REQUEST_METHOD: `POST` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:28.754406 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:28.754516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:28.772261 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.auth.core [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] MFA Rules not processed for user `1f7f9c623a1f47c79a8fa4a52a1af83b`. Rule list: `[]` (Enabled: `True`). {{(pid=79596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:28.773460 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:28.828886 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1456/2878] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:45:28.838433 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:28.839797 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:28.895420 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a09fc-1227-45c6-af55-5e3a837593e7 admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:28.898964 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875cedb-4ed2-479d-854e-5039a5c9c99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:28.899600 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875cedb-4ed2-479d-854e-5039a5c9c99e service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:28.903623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875cedb-4ed2-479d-854e-5039a5c9c99e service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:28.903623 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875cedb-4ed2-479d-854e-5039a5c9c99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:28.908940 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875cedb-4ed2-479d-854e-5039a5c9c99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:28.910343 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875cedb-4ed2-479d-854e-5039a5c9c99e service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:28.920075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1423/2879] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:29.329717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:29.331205 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:29.354353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb16da3-20a5-4d10-8135-47fd2e736687 None None] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:29.359753 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:29.360688 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:29.360972 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:29.361250 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] PATH_INFO: `/v3/projects/13e35f3990a84544aa5cd9389b1469c0` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:29.362669 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e35f3990a84544aa5cd9389b1469c0)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:29.364516 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:29.492268 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e35f3990a84544aa5cd9389b1469c0', 'request_id': 'req-7c35e103-5c0f-4c4f-8e86-63d0a9223765'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:29.594897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e35f3990a84544aa5cd9389b1469c0', 'request_id': 'req-7c35e103-5c0f-4c4f-8e86-63d0a9223765'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:29.601816 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e35f3990a84544aa5cd9389b1469c0', 'request_id': 'req-7c35e103-5c0f-4c4f-8e86-63d0a9223765'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:29.617254 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] The token cache is being invalidate because project 13e35f3990a84544aa5cd9389b1469c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:45:29.617554 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:29.618209 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:45:29.619798 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1457/2880] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:45:29 2022] DELETE /identity/v3/projects/13e35f3990a84544aa5cd9389b1469c0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:45:48.809018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:48.809520 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:48.809633 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:48.827103 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] MFA Rules not processed for user `fa4b889b3aff47cea0a0d254870515cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:45:48.828261 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:48.878868 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1424/2881] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:45:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:03.930865 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:03.932329 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:03.994927 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35e103-5c0f-4c4f-8e86-63d0a9223765 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:04.000007 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:04.000897 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:04.001171 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:04.001442 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] PATH_INFO: `/v3/users/9e6600897456464a8af678bd97146ebf` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:04.002600 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6600897456464a8af678bd97146ebf)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:04.004538 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:04.186804 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6600897456464a8af678bd97146ebf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.193750 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6600897456464a8af678bd97146ebf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.208622 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6600897456464a8af678bd97146ebf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.291619 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6600897456464a8af678bd97146ebf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.292242 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6600897456464a8af678bd97146ebf'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.299194 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1458/2882] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:46:03 2022] DELETE /identity/v3/users/9e6600897456464a8af678bd97146ebf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:46:04.551075 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:04.563718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f9c5-fa53-44a7-bfb1-dd4551f079b8 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:04.623128 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:04.623992 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:04.624273 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:04.624584 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] PATH_INFO: `/v3/projects/eee074218f5d45c09d213dc996c172b5` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:04.625780 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee074218f5d45c09d213dc996c172b5)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:04.627761 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:04.707932 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee074218f5d45c09d213dc996c172b5', 'request_id': 'req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.713960 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee074218f5d45c09d213dc996c172b5', 'request_id': 'req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.719741 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee074218f5d45c09d213dc996c172b5', 'request_id': 'req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.788489 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] The token cache is being invalidate because project eee074218f5d45c09d213dc996c172b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:46:04.788785 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.789401 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-8744e2e8-5ee7-459b-aea4-48fdd0ba53d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:04.790912 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1425/2883] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:46:04 2022] DELETE /identity/v3/projects/eee074218f5d45c09d213dc996c172b5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:00.178960 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:00.180295 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:00.256116 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a987eb2-34b9-4ba9-a1ba-21759a09f005 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:00.302450 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:00.303087 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:00.303393 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:00.303667 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:00.305514 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:00.361223 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:00.362664 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:00.371336 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1459/2884] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:11.791966 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] REQUEST_METHOD: `POST` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:11.792400 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:11.792535 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:11.810567 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.auth.core [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] MFA Rules not processed for user `fa4b889b3aff47cea0a0d254870515cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:11.811749 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:11.818606 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1426/2885] 10.222.0.90 () {58 vars in 957 bytes} [Mon Feb 21 01:48:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:11.853561 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:11.854986 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:11.866139 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeecdd-22ac-42b9-b000-f53444765e40 service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:11.869913 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e39e92f70b45e39ae07a123beff178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:11.870494 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:11.870780 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:11.871061 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:11.872823 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:11.962022 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:11.963469 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:11.983625 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1460/2886] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:12.265563 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:12.266945 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:12.320143 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b2e9-ec8e-4ef8-be53-07ac8320fff3 None None] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:12.323685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:12.324314 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:12.324630 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:12.324904 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:12.326631 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:12.336129 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:12.337575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:12.345148 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1427/2887] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:14.057026 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:14.060650 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:14.062792 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:14.071646 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9bb8-167a-4528-b2a0-4aee0013186c service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:14.075501 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:14.076133 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:14.076410 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:14.076716 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:14.078518 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:14.092859 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:14.094378 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:14.105462 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1428/2888] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:48:14.125111 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1751820-170a-4b09-9f5b-0f02db85131e service cinder] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:14.130610 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:14.131255 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:14.131534 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:14.131805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:14.134044 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:14.148500 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:14.150081 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:14.159730 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1461/2889] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:16.837052 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:16.845473 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6625-91f2-4926-952c-c91fe44a2a87 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:16.849097 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:16.849718 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:16.849995 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:16.850262 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:16.851971 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:16.861365 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:16.867318 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:16.871481 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1429/2890] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:17.717882 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:17.720013 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:17.736119 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6ca5c-a8d7-40b7-9ca2-4617b579b610 service placement] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:17.743224 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a526052e42248f3a38b329084dd262c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:17.744274 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:17.744847 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:17.745350 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:17.747508 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:17.761099 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:17.762717 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:17.775284 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1462/2891] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:31.934345 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:31.942712 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba1d8b-83c6-48f6-b86e-19a28ae5324d service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:31.946289 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:31.946913 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:31.947195 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:31.947467 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:31.949249 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:32.009193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:32.010610 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:32.020330 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1430/2892] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:50:25.649002 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:50:25.660444 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba7f4-31c3-4444-8e63-f291d54d17b9 service nova] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:50:25.665975 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:50:25.666626 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:50:25.666899 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:50:25.667186 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:50:25.669014 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:50:25.681648 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:50:25.683272 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:50:25.693805 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1463/2893] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:50:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:50:40.535344 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:50:40.543878 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7007-bd2a-4212-a673-6a945f1d525b service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:50:40.547440 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a673d8aa3054723887a56a4f4f76c90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:50:40.548070 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] REQUEST_METHOD: `GET` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:50:40.548349 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:50:40.548654 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:50:40.550411 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:50:40.612018 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:50:40.613544 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:50:40.623688 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1431/2894] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:50:48.103590 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:50:48.105616 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:50:48.122410 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef8fd-6475-41e2-8f07-3562b7cb3922 service placement] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:50:48.127537 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:50:48.128632 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:50:48.129057 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:50:48.129419 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] PATH_INFO: `/v3/users/fa4b889b3aff47cea0a0d254870515cd` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:50:48.130617 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4b889b3aff47cea0a0d254870515cd)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:50:48.132767 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:50:48.294431 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4b889b3aff47cea0a0d254870515cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.301217 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4b889b3aff47cea0a0d254870515cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.312533 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4b889b3aff47cea0a0d254870515cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.381490 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4b889b3aff47cea0a0d254870515cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.382107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4b889b3aff47cea0a0d254870515cd'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.387943 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1464/2895] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:50:48 2022] DELETE /identity/v3/users/fa4b889b3aff47cea0a0d254870515cd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:50:48.641431 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:50:48.653575 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003e83-3023-42c3-9703-dc1d3fda2188 service neutron] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:50:48.710360 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:50:48.711211 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:50:48.711497 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:50:48.711774 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] PATH_INFO: `/v3/projects/94593ad3d3934da1ab80ce0c851c7d3e` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:50:48.712990 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=94593ad3d3934da1ab80ce0c851c7d3e)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:50:48.714897 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:50:48.807105 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94593ad3d3934da1ab80ce0c851c7d3e', 'request_id': 'req-73ccd0f5-282d-473d-89dc-b10d702a50aa'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.813050 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94593ad3d3934da1ab80ce0c851c7d3e', 'request_id': 'req-73ccd0f5-282d-473d-89dc-b10d702a50aa'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.818193 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94593ad3d3934da1ab80ce0c851c7d3e', 'request_id': 'req-73ccd0f5-282d-473d-89dc-b10d702a50aa'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.876963 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] The token cache is being invalidate because project 94593ad3d3934da1ab80ce0c851c7d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:50:48.877250 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.877869 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:48.879434 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1432/2896] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:50:48 2022] DELETE /identity/v3/projects/94593ad3d3934da1ab80ce0c851c7d3e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:50:48.884162 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:50:48.885707 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:50:48.898977 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2fb68-b7de-4d23-bdfe-689d9ad12a35 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:50:48.954402 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:50:48.955262 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:50:48.955542 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:50:48.955821 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] PATH_INFO: `/v3/users/46dad744629f43fd9c7c4b0ac2d7bbc5` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:50:48.957067 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dad744629f43fd9c7c4b0ac2d7bbc5)` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:50:48.959788 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:50:49.129700 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dad744629f43fd9c7c4b0ac2d7bbc5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.136392 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dad744629f43fd9c7c4b0ac2d7bbc5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.148175 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dad744629f43fd9c7c4b0ac2d7bbc5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.232815 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dad744629f43fd9c7c4b0ac2d7bbc5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.233426 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.notifications [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dad744629f43fd9c7c4b0ac2d7bbc5'} {{(pid=79596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.239564 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1465/2897] 10.222.0.90 () {58 vars in 1223 bytes} [Mon Feb 21 01:50:48 2022] DELETE /identity/v3/users/46dad744629f43fd9c7c4b0ac2d7bbc5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:50:49.480227 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Authenticating user token {{(pid=79595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:50:49.481685 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.fernet_utils [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:50:49.494936 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccd0f5-282d-473d-89dc-b10d702a50aa admin admin] Validating token access rules against request {{(pid=79595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:50:49.551782 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7f9c623a1f47c79a8fa4a52a1af83b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9596a32ec75d4659b27e6c7a766d2b35', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:50:49.552666 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:50:49.552942 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:50:49.553208 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] PATH_INFO: `/v3/projects/30a4a0e1e7ea49c382312c6ffc46cbd4` {{(pid=79595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:50:49.554391 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a4a0e1e7ea49c382312c6ffc46cbd4)` {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:50:49.556280 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] RBAC: Authorization granted {{(pid=79595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:50:49.667212 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a4a0e1e7ea49c382312c6ffc46cbd4', 'request_id': 'req-cf1e8784-7610-4da5-84c8-522acc1aaaed'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.673543 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a4a0e1e7ea49c382312c6ffc46cbd4', 'request_id': 'req-cf1e8784-7610-4da5-84c8-522acc1aaaed'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.679335 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a4a0e1e7ea49c382312c6ffc46cbd4', 'request_id': 'req-cf1e8784-7610-4da5-84c8-522acc1aaaed'} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.763706 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] The token cache is being invalidate because project 30a4a0e1e7ea49c382312c6ffc46cbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:50:49.763925 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.764585 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: DEBUG keystone.notifications [None req-cf1e8784-7610-4da5-84c8-522acc1aaaed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:50:49.766367 dv-cinder-813228-6-iscsi devstack@keystone.service[79595]: [pid: 79595|app: 0|req: 1433/2898] 10.222.0.90 () {58 vars in 1232 bytes} [Mon Feb 21 01:50:49 2022] DELETE /identity/v3/projects/30a4a0e1e7ea49c382312c6ffc46cbd4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:55:33.666445 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Authenticating user token {{(pid=79596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:55:33.667851 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:55:33.802740 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3290d2-70e2-4716-a842-13b7a0efce61 admin admin] Validating token access rules against request {{(pid=79596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:55:33.859107 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cfe1d2d99d34692a0706f569971bfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75be4377b0234a698fd3c197146c7946', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:55:33.859758 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] REQUEST_METHOD: `GET` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:55:33.860075 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] SCRIPT_NAME: `/identity` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:55:33.860353 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:55:33.862189 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.fernet_utils [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:55:33.873128 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:55:33.874716 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c853-2860-444a-bcf6-2b8040203059 service placement] RBAC: Authorization granted {{(pid=79596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:55:33.884466 dv-cinder-813228-6-iscsi devstack@keystone.service[79596]: [pid: 79596|app: 0|req: 1466/2899] 10.222.0.90 () {60 vars in 1365 bytes} [Mon Feb 21 01:55:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)